What's New -- 0.22.1 Release

[nicolay-r]

WHAT'S NEW:

• 📓 Provide BRAT-based reader (refactoring) of documents and mentioned entities in it! 🥳
• 🔧 Provide verbose treatment of values for SynonymsCollection (SynonymsCollection -- value_to_group_id_func does not support expansion by default.  #327)
• 🔧 Fixed embedding issues for Entity type for neural networks (EntitiesFormatting -- Cancelling entity values masking may result in out of embedding vocabulary exception [ARElight backlog] #308)
• 🔧 Refactoring RuSentRel reader, which is now repesents an ontop build over BRAT. (Sources -- RusentRel collection based on brat toolkit serialization format #287)
• 🔧 Attitude annotation performed on a fly within a pipeline! (Annotation -- Opinion annotation should be implemented at OpinionOperations.iter_opinions_for_extraction #281)
• 🔧 Opinion annotation does not depend on the experiment (Annotator and algorithm is not related to experiment. #250)
• 🔧 StringWithEmbeddingNetworkTermMapping -- has hard-coded algorithms for tokens and terms embedding creation. #347
• 🆕 added utils contrib part and there were moved 🥳
  - evaluation (2-3 scale)
  - cv-splittings (Experiment cv to contrib.utils #324)
  - entity formatters
  - synonyms collections templates: stemmer-based
  - experiment handlers (Experiment handlers to contrib.utils #325)
  - np_utils -- utils to interact with np-serialized data (np_utils -- move from networks to utils contrib part #348)
  - pipelines ➿ for opinions extraction and data serialization, text processing: we are now able to declare a custom pipeline and adopt serialization for a variety of RE tasks
  (BERT and Network Serialization -- refactoring duplicated serialization implementations #322),
  (Experiment pipelines to contrib.utils #326)
  (Processing module -- Multiple Languages Scaling [Eng/Rus] [Contents Relocation] #351)
• 🆕 API for conversion of external text_opinions into parsed_news (BaseParsedNewsServiceProvider -- support conversion from Entity to DocumentEntity #338)
• 🆕 API for a variety of pipelines for data preparation, depending on DataType (Data Serialization -- update API that allow to provide a particular pipeline processor for each DataType [Backlog] #343)
• 🆕 DataType now includes Dev and Etalon by default (DataType -- provide Dev and Etalon default types [QUICK fix] #345)
• 🆕 Evaluation refactoring, and support TextOpinion level results evaluation (Evaluation -- support results evaluation for TextOpinion #355)
• 🗑️ experimential_rusentrel contrib part removed (exp_joined -- removed such experiment at experiment_rusentrel contrib #321)
• 🗑️ OpinionRowsProvider should be removed [ARElight backlog] (BaseOpinionsRowProvider -- useless class and hence should be removed [refactoring IOUtils] #282)
• fixed: iter_rows_linked_by_text_opinions -- fixed bug with incorrect check. Removed doc-related check. #356