Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Remove/rankers #1537

Merged
merged 18 commits into from Apr 6, 2022
Merged

Remove/rankers #1537

merged 18 commits into from Apr 6, 2022

Conversation

vaskonov
Copy link
Contributor

@vaskonov vaskonov commented Mar 23, 2022 •
edited

@puleon puleon self-requested a review April 4, 2022 09:40
IgnatovFedor
IgnatovFedor requested changes Apr 4, 2022
View reviewed changes
Copy link
Collaborator

@IgnatovFedor IgnatovFedor left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

rel_ranking.json is used by kbqa configs and mentioned in the kbqa.rst

@IgnatovFedor IgnatovFedor merged commit eb2fa46 into dev Apr 6, 2022
@IgnatovFedor IgnatovFedor deleted the remove/rankers branch April 6, 2022 12:16
dimakarp1996 added a commit to dimakarp1996/DeepPavlov that referenced this pull request Jul 5, 2022
@dimakarp1996 @IgnatovFedor
@mtalimanchuk @vaskonov @slowwavesleep @yurakuratov @cryoff @Ihab-Asaad @AlekseyKorshuk @dmitrijeuseew @Arij-Aladel
Dev (#13)
06d85c0 
* feat: Python pipeline wrappers (deeppavlov#1491)

* feat: python pipeline wrappers

* minor docstring fixes

* docs: minor docstring edit

Co-authored-by: Maxim Talimanchuk <mtalimanchuk@gmail.com>

* refactor: Remove deeppavlov.configs.elmo (deeppavlov#1498)

* removed elmo config files

* removed elmo_file_paths_iterator, elmo_model and file_paths_reader

* refactor: returned file_paths_reader

* docs: newlines in file_paths_reader docstring

* refactor: remove deeppavlov.configs.skills (deeppavlov#1499)

* remove: deeppavlov.configs.skills

* delete: aiml_skill component

* remove: rasa_skill component

* remove: DSLSkill component

* docs: removed skills from docs apiref

* Feat/glue superglue update (deeppavlov#1508)

* Add wnli config

* Update copa config

* Fix path

* Fix record path

* Exclude train from evaluation

* Exclude train from evaluation

* add ranker

* update ranker

* feat: deeppavlov version update

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>
Co-authored-by: slowwavesleep <44175589+slowwavesleep@users.noreply.github.com>

* fix: upload DeepPavlov BERT models with MLM & NSP heads parameters (deeppavlov#1502)

* fix: update urls to fixed BERT models

* fix: table in pretrained_vectors docpage

* fix: change bert_config_path to .../config.json

* fix: add tokenizer_config.json, config.json to BERT-sentence models

* fix: en_core_web_sm load error during tests (deeppavlov#1524)

* fix: en_core_web_sm loading error

* docs: fix comments grammar

* Minor change: fix typo (deeppavlov#1517)

* remove: Unnecessary models and components (deeppavlov#1523)

* remove: unpopular configs and components

* refactor: squad_ru_torch_bert -> squad_ru_bert + squad_ru_bert_infer moved to torch

* refactor: squad_torch_bert[_infer] -> squad_bert[_infer]

* refactor: ner_rus_bert_torch -> ner_rus_bert

* refactor: ner_ontonotes_bert[_mult]_torch -> ner_ontonotes_bert[_mult]

* refactor: ner_conll2003_torch_bert -> ner_conll2003_bert

* insults_kaggle_bert_torch -> insults_kaggle_bert

* refactor: ranking_ubuntu_v2_torch_bert_uncased -> ranking_ubuntu_v2_bert_uncased

* Revert "refactor: squad_torch_bert[_infer] -> squad_bert[_infer]"

This reverts commit fb5bfed.

* Revert "refactor: ner_conll2003_torch_bert -> ner_conll2003_bert"

This reverts commit 7fee5e5.

* Revert "refactor: ranking_ubuntu_v2_torch_bert_uncased -> ranking_ubuntu_v2_bert_uncased"

This reverts commit e656079.

* Revert "refactor: ner_ontonotes_bert[_mult]_torch -> ner_ontonotes_bert[_mult]"

This reverts commit bb41a58.

* remove: jupyter example notebooks

* remove: asr and tts components and models (deeppavlov#1526)

* feat: python 3.8/3.9 support (deeppavlov#1525)

* refactor: dependencies is weakened to allow run deeppavlov on python 3.8/3.9

* fix: joblib import and doc build errors

* feat: added python3 tests and lowered pytoch version upper bound

* fix: Jenkinsfile venv6 usage

* refactor: reverted minor jenkinsfile changes

* feat: docker containers initial commit

* fix: Dockerfile and cmd.sh errors

* feat: call container tests from jenkinsfile

* fix: added entrypoint to image

* feat: printenv in jenkinsfile and cmd.sh for debut purposes

* fix: tfidf_logreg_en_faq compatibility with newer scikit-learn versions

* fix: tfidf_logreg_autofaq compatibility with sklearn 0.24+

* fix: removed test_tf_layers for python3.8+

* refactor: torch.nn.modules.module.ModuleAttributeError -> AttributeError

* feat: skip tensorflow-based model tests on python 3.8/3.9

* fix: locales for hdt installation

* fix: added pybind11 to image to fix kbqa/el

* refactor: building python from sources in docker images

* fix: escape dollar sign in the Jenkinsfile

* fix: added pip upgrade to fix cryptography installation error

* fix: RECORD file not fould error for installation of the older pybind11

* fix: skip_tf_config for configs located in test_src_dir

* fix: en_ranker_pop_wiki_test

* fix: update tfidf_logreg_autofaq_psearch logreg pkl to newer sklearn version

* refactor: spacy version update

* feat: added build-essential to dockerfile and updated kenlm to fix some tests

* fix: lxml python3.9 build

* Using Transformers 4.6 with torch_bert_ranker (deeppavlov#1532)

* Update transformer version in bert_ranker

* delete bert_config_file from .json

* remove: transformers28.txt from requirements

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* Remove/zh squad (deeppavlov#1534)

* Remove zh squad

* Remove tests

* Fix docs

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* remove: elmo (deeppavlov#1533)

* Remove elmo and elmo classifiers

* Delete elmo tests

* Fix docs

* docs: returned metric and dataset name for elmo

* Add Python code sample for ELMo

* fix: docs build

* docs: removed elmo model from README.md

* docs: removed team

* docs: added 3.8 and 3.9 support info

* refactor: jinja2 requirement moved from common requirements to docs

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* Remove/rankers (deeppavlov#1537)

* Remove ranking

* Fix config

* Remove bert_sep_ranker

* Remove bert_sep_ranker

* Fix docs

* Clean up rankers

* Restore rel_ranking

* Fix references order

* Fix docs

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* feat: Checking test containers exit codes (deeppavlov#1543)

* feat: checking containers exit code

* fix: torch_transformers_squad[_infer] added to requirements_registry

* feat: docker network prune

* fix: false non-zero exit in the end of tests stage

* refactor: network prune -> network rm specific network

* fix: wrong network name in the finnaly section

* feat: added pre-loaded wikipedia_100K_vocab to brillmoore_wikitypos_en

* fix: docker network cleaning

* fix: config view (deeppavlov#1529)

* fix: config view

* Update ner.rst

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* remove: telegram, msbot, alexa, alice connectors (deeppavlov#1548)

* Delete Telegram

* delete msbot, alexa, and alics connectors

* delete images and functions used in removed connectors, revert some changes in README.md

* update contribution_guide

* update contribution_guide.rst

* refactor: small formatting changes and contribution guide update

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* feat: aliases (deeppavlov#1547)

* feat: model aliasing mechanism

* refactor: depration message

* NER migrate to PyTorch (deeppavlov#1545)

* add crf to ner

* remove tf ner configs

* update ner configs

* update configs with probas

* update ner docs

* remove lstm ner model

* reformat

* refactor

* replace allennlp with torchcrf

* fix: torchcrf added to autodoc_mock_imports list

* crf fixes

* refactor

* feat: ner and sentseg aliases

* add ner_collection3_bert to tests

* fix tests

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* remove: gobot (deeppavlov#1544)

* remove: gobot configs, docs and part of py files

* remove: all remained files from deeppavlov.models.gobot

* remove: gobot from README.md and requirements_registry

* entity linking to pytorch and reduce ram and gpu (deeppavlov#1516)

* lite entity linking

* fixes

* kbqa to pytorch and lite

* el and kbqa updates

* remove redundant components

* update outputs of ner configs

* update components registry

* reformat

* docstrings

* rename configs

* update tests

* update docs

* update docs

* add init.py

* refactor

* fix tests

* fix tests

* fix requirements

* fixes

* fix kbqa requirements and downloads

* fix downloads

* update requirements

* fix tests

* fix downloads

* feat: kbqa aliases

* remove: rel_ranking_infer requirement_registry duplicate

* refactor

* refactor

* update typing

* refactor

* refactor

* fixes

* refactor: license, import order, etc.

* refactor: removed ranking training configs, devices type changed

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* remove: mt-bert (deeppavlov#1560)

* Replace tf squad with pytorch configs (deeppavlov#1539)

* replace tf squad with torch

* fixes

* infer in call method

* update redundant configs

* reformat, update config names in odqa

* fix config names in tests

* refactor

* update configs parameters

* update squad configs in tests

* refactor

* add score from 0 to 1

* fix docs

* update tests

* fix docs

* Update squad_ru_bert.json

* fix multi-gpu inference

* fix multi-gpu inference

* fix squad training

* odqa fixes

* refactor

* refactor: import order

* refactor: squad_preprocessor imports

* refactor

* update config names

* remove redundant squad configs

* update docs

* fix: removed unexisting configs from test_quick_start

* feat: squad aliases

* loading in base class

* refactor

* fix torch model

* remove lang

* remove lang

* refactor: removed redundand newlines in two configs

* remove strict load flag

* rename configs, add squad2 config

* update docs, remove redundant config

* feat: instafail

* replace checkpoints with old transformers version with new checkpoints

* rename configs

* refactor: docs and redundant requirements

* add sent_tokenize

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* remove: 35 unused components (deeppavlov#1563)

* update: registry.json

* remove: matplotlib from rured_reader

* refactor: updated requirements_registry and some requirement txt files

* remove: bilstm_nn component

* remove: bow component

* remove: dialog_db_result_iterator component

* remove: dialog_iterator component

* remove: dialog_indexing_iterator component

* remove: dstc_slotfilling component

* remove: dstc2_intents_iterator component

* remove: dstc2_ner_iterator component

* remove: sqlite_database component

* remove: ubuntu_v2_mt_reader component

* remove: siamese_reader component

* remove: kvret_reader component

* remove: kvret_dialog_iterator component

* remove: rel_ranker component

* remove: slotfill_raw[_rasa] components

* remove: simple_dstc2_reader component

* remove: md_yaml_dialogs_reader component

* remove: dstc2_reader component

* remove: char_splitter component

* remove: char_splitting_lowercase_preprocessor component

* remove: convert_ids2tags component

* remove: two_sentences_emb component

* remove: ru_sent_tokenizer component

* remove: random_emb_mat component

* remove: pymorphy_russian_lemmatizer component

* remove: ner_preprocessor component

* remove: multitask_iterator and multitask_reader components

* remove: kbqa_reader component

* remove: file_paths_reader and file_paths_iterator component

* remove: emb_mat_assembler

* remove: dictionary_vectorizer component

* remove: capitalization_featurizer component

* remove: glove component

* fix: nvidia source cert error

* fix: spacy models added to some components in requirements registry

* refactor: newline at the end of ru_core_news_sm

* remove: intent-catcher (deeppavlov#1564)

* refactor: all classifier models to pytorch (deeppavlov#1565)

* Replace tensorflow syntax parser with pytorch syntax parser from slovnet (deeppavlov#1569)

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* remove: syntaxparser and morphotagger (deeppavlov#1573)

* refactor: train logging (deeppavlov#1572)

Co-authored-by: yurakuratov <9271630+yurakuratov@users.noreply.github.com>

* feat: nested configs overwriting (deeppavlov#1561)

* remove: TensorFlow (deeppavlov#1574)

* feat: external metrics (deeppavlov#1546)

Co-authored-by: Arij Aladel <arij.aladel@gmial.com>
Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* Add ner case-agnostic config (deeppavlov#1570)

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* update: requirements (deeppavlov#1578)

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>
Co-authored-by: Maxim Talimanchuk <mtalimanchuk@gmail.com>
Co-authored-by: Vasily <vaskonov@users.noreply.github.com>
Co-authored-by: slowwavesleep <44175589+slowwavesleep@users.noreply.github.com>
Co-authored-by: yurakuratov <9271630+yurakuratov@users.noreply.github.com>
Co-authored-by: mak <cardigan99@mail.ru>
Co-authored-by: Ihab-Asaad <56175482+Ihab-Asaad@users.noreply.github.com>
Co-authored-by: Aleksey Korshuk <48794610+AlekseyKorshuk@users.noreply.github.com>
Co-authored-by: dmitrijeuseew <dmitrij.euseew@yandex.ru>
Co-authored-by: Arij-Aladel <68355048+Arij-Aladel@users.noreply.github.com>
Co-authored-by: Arij Aladel <arij.aladel@gmial.com>
dimakarp1996 added a commit to dimakarp1996/DeepPavlov that referenced this pull request Jul 11, 2022
@dimakarp1996 @IgnatovFedor
@mtalimanchuk @vaskonov @slowwavesleep @yurakuratov @cryoff @Ihab-Asaad @AlekseyKorshuk @dmitrijeuseew @Arij-Aladel
Dev (#15)
3d89e9d 
* feat: Python pipeline wrappers (deeppavlov#1491)

* feat: python pipeline wrappers

* minor docstring fixes

* docs: minor docstring edit

Co-authored-by: Maxim Talimanchuk <mtalimanchuk@gmail.com>

* refactor: Remove deeppavlov.configs.elmo (deeppavlov#1498)

* removed elmo config files

* removed elmo_file_paths_iterator, elmo_model and file_paths_reader

* refactor: returned file_paths_reader

* docs: newlines in file_paths_reader docstring

* refactor: remove deeppavlov.configs.skills (deeppavlov#1499)

* remove: deeppavlov.configs.skills

* delete: aiml_skill component

* remove: rasa_skill component

* remove: DSLSkill component

* docs: removed skills from docs apiref

* Feat/glue superglue update (deeppavlov#1508)

* Add wnli config

* Update copa config

* Fix path

* Fix record path

* Exclude train from evaluation

* Exclude train from evaluation

* add ranker

* update ranker

* feat: deeppavlov version update

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>
Co-authored-by: slowwavesleep <44175589+slowwavesleep@users.noreply.github.com>

* fix: upload DeepPavlov BERT models with MLM & NSP heads parameters (deeppavlov#1502)

* fix: update urls to fixed BERT models

* fix: table in pretrained_vectors docpage

* fix: change bert_config_path to .../config.json

* fix: add tokenizer_config.json, config.json to BERT-sentence models

* fix: en_core_web_sm load error during tests (deeppavlov#1524)

* fix: en_core_web_sm loading error

* docs: fix comments grammar

* Minor change: fix typo (deeppavlov#1517)

* remove: Unnecessary models and components (deeppavlov#1523)

* remove: unpopular configs and components

* refactor: squad_ru_torch_bert -> squad_ru_bert + squad_ru_bert_infer moved to torch

* refactor: squad_torch_bert[_infer] -> squad_bert[_infer]

* refactor: ner_rus_bert_torch -> ner_rus_bert

* refactor: ner_ontonotes_bert[_mult]_torch -> ner_ontonotes_bert[_mult]

* refactor: ner_conll2003_torch_bert -> ner_conll2003_bert

* insults_kaggle_bert_torch -> insults_kaggle_bert

* refactor: ranking_ubuntu_v2_torch_bert_uncased -> ranking_ubuntu_v2_bert_uncased

* Revert "refactor: squad_torch_bert[_infer] -> squad_bert[_infer]"

This reverts commit fb5bfed.

* Revert "refactor: ner_conll2003_torch_bert -> ner_conll2003_bert"

This reverts commit 7fee5e5.

* Revert "refactor: ranking_ubuntu_v2_torch_bert_uncased -> ranking_ubuntu_v2_bert_uncased"

This reverts commit e656079.

* Revert "refactor: ner_ontonotes_bert[_mult]_torch -> ner_ontonotes_bert[_mult]"

This reverts commit bb41a58.

* remove: jupyter example notebooks

* remove: asr and tts components and models (deeppavlov#1526)

* feat: python 3.8/3.9 support (deeppavlov#1525)

* refactor: dependencies is weakened to allow run deeppavlov on python 3.8/3.9

* fix: joblib import and doc build errors

* feat: added python3 tests and lowered pytoch version upper bound

* fix: Jenkinsfile venv6 usage

* refactor: reverted minor jenkinsfile changes

* feat: docker containers initial commit

* fix: Dockerfile and cmd.sh errors

* feat: call container tests from jenkinsfile

* fix: added entrypoint to image

* feat: printenv in jenkinsfile and cmd.sh for debut purposes

* fix: tfidf_logreg_en_faq compatibility with newer scikit-learn versions

* fix: tfidf_logreg_autofaq compatibility with sklearn 0.24+

* fix: removed test_tf_layers for python3.8+

* refactor: torch.nn.modules.module.ModuleAttributeError -> AttributeError

* feat: skip tensorflow-based model tests on python 3.8/3.9

* fix: locales for hdt installation

* fix: added pybind11 to image to fix kbqa/el

* refactor: building python from sources in docker images

* fix: escape dollar sign in the Jenkinsfile

* fix: added pip upgrade to fix cryptography installation error

* fix: RECORD file not fould error for installation of the older pybind11

* fix: skip_tf_config for configs located in test_src_dir

* fix: en_ranker_pop_wiki_test

* fix: update tfidf_logreg_autofaq_psearch logreg pkl to newer sklearn version

* refactor: spacy version update

* feat: added build-essential to dockerfile and updated kenlm to fix some tests

* fix: lxml python3.9 build

* Using Transformers 4.6 with torch_bert_ranker (deeppavlov#1532)

* Update transformer version in bert_ranker

* delete bert_config_file from .json

* remove: transformers28.txt from requirements

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* Remove/zh squad (deeppavlov#1534)

* Remove zh squad

* Remove tests

* Fix docs

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* remove: elmo (deeppavlov#1533)

* Remove elmo and elmo classifiers

* Delete elmo tests

* Fix docs

* docs: returned metric and dataset name for elmo

* Add Python code sample for ELMo

* fix: docs build

* docs: removed elmo model from README.md

* docs: removed team

* docs: added 3.8 and 3.9 support info

* refactor: jinja2 requirement moved from common requirements to docs

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* Remove/rankers (deeppavlov#1537)

* Remove ranking

* Fix config

* Remove bert_sep_ranker

* Remove bert_sep_ranker

* Fix docs

* Clean up rankers

* Restore rel_ranking

* Fix references order

* Fix docs

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* feat: Checking test containers exit codes (deeppavlov#1543)

* feat: checking containers exit code

* fix: torch_transformers_squad[_infer] added to requirements_registry

* feat: docker network prune

* fix: false non-zero exit in the end of tests stage

* refactor: network prune -> network rm specific network

* fix: wrong network name in the finnaly section

* feat: added pre-loaded wikipedia_100K_vocab to brillmoore_wikitypos_en

* fix: docker network cleaning

* fix: config view (deeppavlov#1529)

* fix: config view

* Update ner.rst

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* remove: telegram, msbot, alexa, alice connectors (deeppavlov#1548)

* Delete Telegram

* delete msbot, alexa, and alics connectors

* delete images and functions used in removed connectors, revert some changes in README.md

* update contribution_guide

* update contribution_guide.rst

* refactor: small formatting changes and contribution guide update

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* feat: aliases (deeppavlov#1547)

* feat: model aliasing mechanism

* refactor: depration message

* NER migrate to PyTorch (deeppavlov#1545)

* add crf to ner

* remove tf ner configs

* update ner configs

* update configs with probas

* update ner docs

* remove lstm ner model

* reformat

* refactor

* replace allennlp with torchcrf

* fix: torchcrf added to autodoc_mock_imports list

* crf fixes

* refactor

* feat: ner and sentseg aliases

* add ner_collection3_bert to tests

* fix tests

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* remove: gobot (deeppavlov#1544)

* remove: gobot configs, docs and part of py files

* remove: all remained files from deeppavlov.models.gobot

* remove: gobot from README.md and requirements_registry

* entity linking to pytorch and reduce ram and gpu (deeppavlov#1516)

* lite entity linking

* fixes

* kbqa to pytorch and lite

* el and kbqa updates

* remove redundant components

* update outputs of ner configs

* update components registry

* reformat

* docstrings

* rename configs

* update tests

* update docs

* update docs

* add init.py

* refactor

* fix tests

* fix tests

* fix requirements

* fixes

* fix kbqa requirements and downloads

* fix downloads

* update requirements

* fix tests

* fix downloads

* feat: kbqa aliases

* remove: rel_ranking_infer requirement_registry duplicate

* refactor

* refactor

* update typing

* refactor

* refactor

* fixes

* refactor: license, import order, etc.

* refactor: removed ranking training configs, devices type changed

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* remove: mt-bert (deeppavlov#1560)

* Replace tf squad with pytorch configs (deeppavlov#1539)

* replace tf squad with torch

* fixes

* infer in call method

* update redundant configs

* reformat, update config names in odqa

* fix config names in tests

* refactor

* update configs parameters

* update squad configs in tests

* refactor

* add score from 0 to 1

* fix docs

* update tests

* fix docs

* Update squad_ru_bert.json

* fix multi-gpu inference

* fix multi-gpu inference

* fix squad training

* odqa fixes

* refactor

* refactor: import order

* refactor: squad_preprocessor imports

* refactor

* update config names

* remove redundant squad configs

* update docs

* fix: removed unexisting configs from test_quick_start

* feat: squad aliases

* loading in base class

* refactor

* fix torch model

* remove lang

* remove lang

* refactor: removed redundand newlines in two configs

* remove strict load flag

* rename configs, add squad2 config

* update docs, remove redundant config

* feat: instafail

* replace checkpoints with old transformers version with new checkpoints

* rename configs

* refactor: docs and redundant requirements

* add sent_tokenize

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* remove: 35 unused components (deeppavlov#1563)

* update: registry.json

* remove: matplotlib from rured_reader

* refactor: updated requirements_registry and some requirement txt files

* remove: bilstm_nn component

* remove: bow component

* remove: dialog_db_result_iterator component

* remove: dialog_iterator component

* remove: dialog_indexing_iterator component

* remove: dstc_slotfilling component

* remove: dstc2_intents_iterator component

* remove: dstc2_ner_iterator component

* remove: sqlite_database component

* remove: ubuntu_v2_mt_reader component

* remove: siamese_reader component

* remove: kvret_reader component

* remove: kvret_dialog_iterator component

* remove: rel_ranker component

* remove: slotfill_raw[_rasa] components

* remove: simple_dstc2_reader component

* remove: md_yaml_dialogs_reader component

* remove: dstc2_reader component

* remove: char_splitter component

* remove: char_splitting_lowercase_preprocessor component

* remove: convert_ids2tags component

* remove: two_sentences_emb component

* remove: ru_sent_tokenizer component

* remove: random_emb_mat component

* remove: pymorphy_russian_lemmatizer component

* remove: ner_preprocessor component

* remove: multitask_iterator and multitask_reader components

* remove: kbqa_reader component

* remove: file_paths_reader and file_paths_iterator component

* remove: emb_mat_assembler

* remove: dictionary_vectorizer component

* remove: capitalization_featurizer component

* remove: glove component

* fix: nvidia source cert error

* fix: spacy models added to some components in requirements registry

* refactor: newline at the end of ru_core_news_sm

* remove: intent-catcher (deeppavlov#1564)

* refactor: all classifier models to pytorch (deeppavlov#1565)

* Replace tensorflow syntax parser with pytorch syntax parser from slovnet (deeppavlov#1569)

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* remove: syntaxparser and morphotagger (deeppavlov#1573)

* refactor: train logging (deeppavlov#1572)

Co-authored-by: yurakuratov <9271630+yurakuratov@users.noreply.github.com>

* feat: nested configs overwriting (deeppavlov#1561)

* remove: TensorFlow (deeppavlov#1574)

* feat: external metrics (deeppavlov#1546)

Co-authored-by: Arij Aladel <arij.aladel@gmial.com>
Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* Add ner case-agnostic config (deeppavlov#1570)

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>

* update: requirements (deeppavlov#1578)

Co-authored-by: Fedor Ignatov <ignatov.fedor@gmail.com>
Co-authored-by: Maxim Talimanchuk <mtalimanchuk@gmail.com>
Co-authored-by: Vasily <vaskonov@users.noreply.github.com>
Co-authored-by: slowwavesleep <44175589+slowwavesleep@users.noreply.github.com>
Co-authored-by: yurakuratov <9271630+yurakuratov@users.noreply.github.com>
Co-authored-by: mak <cardigan99@mail.ru>
Co-authored-by: Ihab-Asaad <56175482+Ihab-Asaad@users.noreply.github.com>
Co-authored-by: Aleksey Korshuk <48794610+AlekseyKorshuk@users.noreply.github.com>
Co-authored-by: dmitrijeuseew <dmitrij.euseew@yandex.ru>
Co-authored-by: Arij-Aladel <68355048+Arij-Aladel@users.noreply.github.com>
Co-authored-by: Arij Aladel <arij.aladel@gmial.com>
@IgnatovFedor IgnatovFedor mentioned this pull request Nov 7, 2022
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@IgnatovFedor IgnatovFedor IgnatovFedor approved these changes

@puleon puleon puleon approved these changes

@dmitrijeuseew dmitrijeuseew Awaiting requested review from dmitrijeuseew

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@vaskonov @IgnatovFedor @puleon