Transformer-based Text Normalization Models #2415
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
This pull request introduces 75 alerts when merging 1577ddb into 5fcfa9e - view on LGTM.com new alerts:
|
|
This pull request introduces 15 alerts when merging 4c53304 into 5fcfa9e - view on LGTM.com new alerts:
|
|
This pull request introduces 15 alerts when merging 86c8cb4 into 5fcfa9e - view on LGTM.com new alerts:
|
yzhang123
reviewed
Jun 28, 2021
There was a problem hiding this comment.
- Could you add docstrings to classes and functions? following the format we use? https://github.com/NVIDIA/NeMo/blob/main/nemo/collections/nlp/data/dialogue_state_tracking/sgd/dataset.py#L54-L58
- make sure you sign your commits for CI
- add a small dummy test for ci/jenkins on a dummy dataset to make sure training works
I'll review details in the meantime
nemo/collections/nlp/data/text_normalization/decoder_dataset.py
Outdated
Show resolved
Hide resolved
nemo/collections/nlp/data/text_normalization/decoder_dataset.py
Outdated
Show resolved
Hide resolved
nemo/collections/nlp/models/neural_text_normalization/neural_decoder.py
Outdated
Show resolved
Hide resolved
examples/nlp/neural_text_normalization/neural_text_normalization_test.py
Outdated
Show resolved
Hide resolved
examples/nlp/neural_text_normalization/neural_text_normalization_train.py
Outdated
Show resolved
Hide resolved
yzhang123
suggested changes
Jun 29, 2021
examples/nlp/duplex_text_normalization/conf/duplex_tn_config.yaml
Outdated
Show resolved
Hide resolved
examples/nlp/duplex_text_normalization/conf/duplex_tn_config.yaml
Outdated
Show resolved
Hide resolved
examples/nlp/duplex_text_normalization/duplex_text_normalization_test.py
Outdated
Show resolved
Hide resolved
examples/nlp/duplex_text_normalization/duplex_text_normalization_test.py
Outdated
Show resolved
Hide resolved
examples/nlp/duplex_text_normalization/duplex_text_normalization_train.py
Outdated
Show resolved
Hide resolved
nemo/collections/nlp/data/text_normalization/decoder_dataset.py
Outdated
Show resolved
Hide resolved
nemo/collections/nlp/data/text_normalization/decoder_dataset.py
Outdated
Show resolved
Hide resolved
yzhang123
suggested changes
Jun 29, 2021
nemo/collections/nlp/models/duplex_text_normalization/duplex_decoder.py
Outdated
Show resolved
Hide resolved
nemo/collections/nlp/models/duplex_text_normalization/duplex_decoder.py
Outdated
Show resolved
Hide resolved
nemo/collections/nlp/models/duplex_text_normalization/duplex_tagger.py
Outdated
Show resolved
Hide resolved
nemo/collections/nlp/models/duplex_text_normalization/duplex_tagger.py
Outdated
Show resolved
Hide resolved
nemo/collections/nlp/models/duplex_text_normalization/duplex_tagger.py
Outdated
Show resolved
Hide resolved
* Added a notebook with best practices for telephony speech * Added datasets detaiils * Added training recommendations * Emptied out cells with results * Added tutorial to docs Signed-off-by: jbalam <jbalam@nvidia.com> * Addressed review comments Signed-off-by: jbalam <jbalam@nvidia.com> * Added a line to note original sampling rate of an4 Signed-off-by: jbalam <jbalam@nvidia.com> * Made changes suggested in review Signed-off-by: jbalam <jbalam@nvidia.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com>
* Temp commit Signed-off-by: smajumdar <titu1994@gmail.com> * Initial code for fastemit forward pass Signed-off-by: smajumdar <titu1994@gmail.com> * Correct return reg value Signed-off-by: smajumdar <titu1994@gmail.com> * Initial cpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Try gpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Try gpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Correct few impl Signed-off-by: smajumdar <titu1994@gmail.com> * Update fastemit scaling Signed-off-by: smajumdar <titu1994@gmail.com> * Cleanup fastemit Signed-off-by: smajumdar <titu1994@gmail.com> * Finalize FastEmit regularization PR Signed-off-by: smajumdar <titu1994@gmail.com> * Refactor code to support fastemit regularization Signed-off-by: smajumdar <titu1994@gmail.com> Co-authored-by: Samuel Kriman <samuelkriman@gmail.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com>
* Audio Norm (#2285) * add jenkins test, refactoring Signed-off-by: ekmb <ebakhturina@nvidia.com> * update test Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix new test Signed-off-by: ekmb <ebakhturina@nvidia.com> * add serial to the default normalizer, add tests Signed-off-by: ekmb <ebakhturina@nvidia.com> * manifest test added Signed-off-by: ekmb <ebakhturina@nvidia.com> * expose more params, new test cases Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix jenkins, serial clean, exclude range from cardinal Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins dollar sign format Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins dollar sign format Signed-off-by: ekmb <ebakhturina@nvidia.com> * addressed review comments Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix decimal in measure Signed-off-by: ekmb <ebakhturina@nvidia.com> * move serial in cardinal Signed-off-by: ekmb <ebakhturina@nvidia.com> * clean up Signed-off-by: ekmb <ebakhturina@nvidia.com> * update for SH zero -> oh Signed-off-by: ekmb <ebakhturina@nvidia.com> * change n_tagger default Signed-off-by: ekmb <ebakhturina@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * bumping version to 1.0.1 Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Add check for numba regardless of device Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * upper bound for webdataset Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Correct Dockerfile Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update readmes Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update README (#2332) Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * ddp translate GPU allocation fix (#2312) * fixed branch in IR tutorial Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> * ddp translate GPU allocation fix Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> * map_location instead of set_device Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Shallow fusion (#2315) * fixed branch in IR tutorial Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> * shallow fusion init commit Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> * debug info removed Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * [BUGFIX] Add upper bound to hydra for 1.0.x (#2337) * upper bound hydra Signed-off-by: ericharper <complex451@gmail.com> * upper bound hydra Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update version number Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update package version Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * sparrowhawk tests + punctuation post processing for pynini TN (#2320) * add jenkins test, refactoring Signed-off-by: ekmb <ebakhturina@nvidia.com> * update test Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix new test Signed-off-by: ekmb <ebakhturina@nvidia.com> * add serial to the default normalizer, add tests Signed-off-by: ekmb <ebakhturina@nvidia.com> * manifest test added Signed-off-by: ekmb <ebakhturina@nvidia.com> * expose more params, new test cases Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix jenkins, serial clean, exclude range from cardinal Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins dollar sign format Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins dollar sign format Signed-off-by: ekmb <ebakhturina@nvidia.com> * addressed review comments Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix decimal in measure Signed-off-by: ekmb <ebakhturina@nvidia.com> * move serial in cardinal Signed-off-by: ekmb <ebakhturina@nvidia.com> * sh tests init Signed-off-by: ekmb <ebakhturina@nvidia.com> * sparrowhawk container tests support added Signed-off-by: ekmb <ebakhturina@nvidia.com> * add post process to normalize.py, update tests Signed-off-by: ekmb <ebakhturina@nvidia.com> * remove duplication Signed-off-by: ekmb <ebakhturina@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update notebooks to 1.0.2 release (#2338) Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update ranges for omegaconf and hydra (#2336) * Update ranges Signed-off-by: smajumdar <titu1994@gmail.com> * Updates for Hydra and OmegaConf updates Signed-off-by: smajumdar <titu1994@gmail.com> * Style fixes Signed-off-by: smajumdar <titu1994@gmail.com> * Correct tests and revert patch for model utils Signed-off-by: smajumdar <titu1994@gmail.com> * Correct docstring Signed-off-by: smajumdar <titu1994@gmail.com> * Revert unnecessary change Signed-off-by: smajumdar <titu1994@gmail.com> * Revert unnecessary change Signed-off-by: smajumdar <titu1994@gmail.com> * Guard scheduler for None Signed-off-by: smajumdar <titu1994@gmail.com> * default to 0.0 if bpe_dropout is None Signed-off-by: ericharper <complex451@gmail.com> * Correctly log class that was restored Signed-off-by: smajumdar <titu1994@gmail.com> * Root patch *bpe_dropout Signed-off-by: smajumdar <titu1994@gmail.com> Co-authored-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update FastPitch Export (#2355) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * byt5 unicode implementation, first cut Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * add bytelevel tokenizer Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update out_dir to not collide (#2358) Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update container version to 21.05 (#2309) * Update container version Signed-off-by: smajumdar <titu1994@gmail.com> * Temporarily change export format of waveglow Signed-off-by: smajumdar <titu1994@gmail.com> * Add conda update for numba Signed-off-by: smajumdar <titu1994@gmail.com> * Update numba compat via global flag for strictness level `--relax_numba_compat`, remove pytorchlightning.metrics, refactor out numba utils to core, update tests Signed-off-by: smajumdar <titu1994@gmail.com> * Correct order of numba minimum verion, remove wrong flag from test Signed-off-by: smajumdar <titu1994@gmail.com> * Double test of cuda numba Signed-off-by: smajumdar <titu1994@gmail.com> * Double test of cuda numba Signed-off-by: smajumdar <titu1994@gmail.com> * Enable RNNT tests Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Text Normalization Update (#2356) * upper cased date support Signed-off-by: ekmb <ebakhturina@nvidia.com> * update whitelist, change roman weights Signed-off-by: ekmb <ebakhturina@nvidia.com> * docstrings, space fix, init file Signed-off-by: ekmb <ebakhturina@nvidia.com> * lgtm Signed-off-by: ekmb <ebakhturina@nvidia.com> * fraction with measure class Signed-off-by: ekmb <ebakhturina@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * address comment Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Add ASR CTC tutorial on fine-tuning on another language (#2346) * Add ASR CTC Language finetuning notebook Signed-off-by: smajumdar <titu1994@gmail.com> * Add to documentation Signed-off-by: smajumdar <titu1994@gmail.com> * Improve documentation Signed-off-by: smajumdar <titu1994@gmail.com> * Correct name of the dataset Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Correct colab link to notebook (#2366) Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * sgdqa update data directories for testing (#2323) * sgdqa update data directories for testing Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * fix syntax Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * check if data dir exists Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * fix Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * adding pretrained model Signed-off-by: Yang Zhang <yangzhang@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Added documentation for export() (#2330) * Added export document Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com> * Addressed review comments Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com> Co-authored-by: Eric Harper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update Citrinet model card info (#2369) * Update model card info Signed-off-by: smajumdar <titu1994@gmail.com> * Cleanup Docs Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * [NMT] Model Parallel Megatron Encoders (#2238) * add megatron encoder Signed-off-by: ericharper <complex451@gmail.com> * added megatron to get_nmt_tokenizer Signed-off-by: ericharper <complex451@gmail.com> * add vocab_size and hidden_size to megatron bert Signed-off-by: ericharper <complex451@gmail.com> * add megatron encoder module Signed-off-by: ericharper <complex451@gmail.com> * fixed horrible typo Signed-off-by: ericharper <complex451@gmail.com> * fix typo and add default Signed-off-by: ericharper <complex451@gmail.com> * updating nlp overrides for mp nmt Signed-off-by: ericharper <complex451@gmail.com> * move some logic back to nlpmodel from overrides Signed-off-by: ericharper <complex451@gmail.com> * add checkpoint_file property Signed-off-by: ericharper <complex451@gmail.com> * fix property Signed-off-by: ericharper <complex451@gmail.com> * num_tokentypes=0 Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * find_unused_parameters=True Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * style Signed-off-by: ericharper <complex451@gmail.com> * get instead of pop Signed-off-by: ericharper <complex451@gmail.com> * remove token type ids from megatron input example Signed-off-by: ericharper <complex451@gmail.com> * pop vocab_size Signed-off-by: ericharper <complex451@gmail.com> * fix checkpointing for model parallel Signed-off-by: ericharper <complex451@gmail.com> * fix bug in non model parallel Signed-off-by: ericharper <complex451@gmail.com> * convert cfg.trainer to dict Signed-off-by: ericharper <complex451@gmail.com> * make num_tokentypes configurable for nmt Signed-off-by: ericharper <complex451@gmail.com> * update checkpoint_file when using named megatron model in nemo Signed-off-by: ericharper <complex451@gmail.com> * make vocab_file configurable Signed-off-by: ericharper <complex451@gmail.com> * dataclass can't have mutable default Signed-off-by: ericharper <complex451@gmail.com> * style Signed-off-by: ericharper <complex451@gmail.com> * unused imports Signed-off-by: ericharper <complex451@gmail.com> * revert input example Signed-off-by: ericharper <complex451@gmail.com> * check that checkpoint version is not None Signed-off-by: ericharper <complex451@gmail.com> * add mp jenkins test Signed-off-by: ericharper <complex451@gmail.com> * update docstring Signed-off-by: ericharper <complex451@gmail.com> * add docs for pretrained encoders with nemo nmt Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Add notebook with recommendations for 8 kHz speech (#2326) * Added a notebook with best practices for telephony speech * Added datasets detaiils * Added training recommendations * Emptied out cells with results * Added tutorial to docs Signed-off-by: jbalam <jbalam@nvidia.com> * Addressed review comments Signed-off-by: jbalam <jbalam@nvidia.com> * Added a line to note original sampling rate of an4 Signed-off-by: jbalam <jbalam@nvidia.com> * Made changes suggested in review Signed-off-by: jbalam <jbalam@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Add FastEmit support for RNNT Losses (#2374) * Temp commit Signed-off-by: smajumdar <titu1994@gmail.com> * Initial code for fastemit forward pass Signed-off-by: smajumdar <titu1994@gmail.com> * Correct return reg value Signed-off-by: smajumdar <titu1994@gmail.com> * Initial cpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Try gpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Try gpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Correct few impl Signed-off-by: smajumdar <titu1994@gmail.com> * Update fastemit scaling Signed-off-by: smajumdar <titu1994@gmail.com> * Cleanup fastemit Signed-off-by: smajumdar <titu1994@gmail.com> * Finalize FastEmit regularization PR Signed-off-by: smajumdar <titu1994@gmail.com> * Refactor code to support fastemit regularization Signed-off-by: smajumdar <titu1994@gmail.com> Co-authored-by: Samuel Kriman <samuelkriman@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * byt5 unicode implementation, first cut Signed-off-by: Mike Chrzanowski <mchrzanowski@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * add bytelevel tokenizer Signed-off-by: Mike Chrzanowski <mchrzanowski@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update styling Signed-off-by: Mike Chrzanowski <mchrzanowski@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * avoid circular import Signed-off-by: Mike Chrzanowski <mchrzanowski@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * fix bugs in hifigan code (#2392) Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update setup.py (#2394) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update bytelevel_tokenizer.py Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update bytelevel_tokenizer.py Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * typo Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * missed one Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * bug fixes Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * style fix Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * bytelevelprocessor is now generic. Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * style fix Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update checkpointing (#2396) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * style Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * woops, didnt merge jenkinsfile the right way * add newline Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * undo changes to enja processor Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * processor selection decision fix Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * newline fix Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> Co-authored-by: Evelina <10428420+ekmb@users.noreply.github.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Aleksey Grinchuk (Oleksii Hrinchuk) <grinchuk.alexey@gmail.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Eric Harper <complex451@gmail.com> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: mchrzanowski <mchrzanowski@nvidia.com> Co-authored-by: Yang Zhang <yzhang123@users.noreply.github.com> Co-authored-by: Boris Fomitchev <borisfom@users.noreply.github.com> Co-authored-by: Jagadeesh Balam <4916480+jbalam-nv@users.noreply.github.com> Co-authored-by: Samuel Kriman <samuelkriman@gmail.com> Co-authored-by: Oktai Tatanov <oktai.tatanov@gmail.com> Co-authored-by: root <root@dgx0026.nsv.rno1.nvmetal.net> Co-authored-by: root <root@dgx0079.nsv.rno1.nvmetal.net> Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com>
* Update notebook branch and Jenkinsfile for 1.1.0 testing (#2378) * update branch Signed-off-by: ericharper <complex451@gmail.com> * update jenkinsfile Signed-off-by: ericharper <complex451@gmail.com> * [BUGFIX] NMT Multi-node was incorrectly computing num_replicas (#2380) * fix property when not using model parallel Signed-off-by: ericharper <complex451@gmail.com> * fix property when not using model parallel Signed-off-by: ericharper <complex451@gmail.com> * add debug statement Signed-off-by: ericharper <complex451@gmail.com> * add debug statement Signed-off-by: ericharper <complex451@gmail.com> * instantiate with NLPDDPPlugin with num_nodes from trainer config Signed-off-by: ericharper <complex451@gmail.com> * Update ASR scripts for tokenizer building and tarred dataset building (#2381) * Update ASR scripts for tokenizer building and tarred dataset building Signed-off-by: smajumdar <titu1994@gmail.com> * Update container Signed-off-by: smajumdar <titu1994@gmail.com> * Add STT Zh Citrinet 1024 Gamma 0.25 model Signed-off-by: smajumdar <titu1994@gmail.com> * Update notebook (#2391) Signed-off-by: smajumdar <titu1994@gmail.com> * ASR Notebooks fix for 1.1.0 (#2395) * nb fix for spring clean Signed-off-by: fayejf <fayejf07@gmail.com> * remove outdated instruction Signed-off-by: fayejf <fayejf07@gmail.com> * Mean normalization (#2397) * norm embeddings Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * move to utils Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * Bugfix adaptive spec augment time masking (#2398) * bugfix adaptive spec augment Signed-off-by: smajumdar <titu1994@gmail.com> * Revert freq mask guard Signed-off-by: smajumdar <titu1994@gmail.com> * Revert freq mask guard Signed-off-by: smajumdar <titu1994@gmail.com> * Remove static time width clamping Signed-off-by: smajumdar <titu1994@gmail.com> * Correct typos and issues with notebooks (#2402) * Fix Primer notebook Signed-off-by: smajumdar <titu1994@gmail.com> * Typo Signed-off-by: smajumdar <titu1994@gmail.com> * remove accelerator=DDP in tutorial notebooks to avoid errors. (#2403) Signed-off-by: Hoo Chang Shin <hshin@nvidia.com> Co-authored-by: Hoo Chang Shin <hshin@nvidia.com> * style Signed-off-by: ericharper <complex451@gmail.com> * update jenkins branch Signed-off-by: ericharper <complex451@gmail.com> * update notebook branch to main Signed-off-by: ericharper <complex451@gmail.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: fayejf <36722593+fayejf@users.noreply.github.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: khcs <khcs@users.noreply.github.com> Co-authored-by: Hoo Chang Shin <hshin@nvidia.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com>
added 6 commits
June 30, 2021 18:39
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
|
This pull request introduces 1 alert when merging 76359fa into 5fcfa9e - view on LGTM.com new alerts:
|
added 2 commits
July 2, 2021 11:18
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
|
This pull request introduces 2 alerts when merging 9325b04 into c5dbf45 - view on LGTM.com new alerts:
|
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
yzhang123
reviewed
Jul 7, 2021
yzhang123
approved these changes
Jul 7, 2021
|
Thanks, I fixed the styles and added the references. |
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
Signed-off-by: Tuan Lai <tuanl@nvidia.com>
pasandi20
pushed a commit
to pasandi20/NeMo
that referenced
this pull request
Jul 13, 2021
* Add notebook with recommendations for 8 kHz speech (NVIDIA#2326) * Added a notebook with best practices for telephony speech * Added datasets detaiils * Added training recommendations * Emptied out cells with results * Added tutorial to docs Signed-off-by: jbalam <jbalam@nvidia.com> * Addressed review comments Signed-off-by: jbalam <jbalam@nvidia.com> * Added a line to note original sampling rate of an4 Signed-off-by: jbalam <jbalam@nvidia.com> * Made changes suggested in review Signed-off-by: jbalam <jbalam@nvidia.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add FastEmit support for RNNT Losses (NVIDIA#2374) * Temp commit Signed-off-by: smajumdar <titu1994@gmail.com> * Initial code for fastemit forward pass Signed-off-by: smajumdar <titu1994@gmail.com> * Correct return reg value Signed-off-by: smajumdar <titu1994@gmail.com> * Initial cpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Try gpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Try gpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Correct few impl Signed-off-by: smajumdar <titu1994@gmail.com> * Update fastemit scaling Signed-off-by: smajumdar <titu1994@gmail.com> * Cleanup fastemit Signed-off-by: smajumdar <titu1994@gmail.com> * Finalize FastEmit regularization PR Signed-off-by: smajumdar <titu1994@gmail.com> * Refactor code to support fastemit regularization Signed-off-by: smajumdar <titu1994@gmail.com> Co-authored-by: Samuel Kriman <samuelkriman@gmail.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Implement inference functions of TN models Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Minor Fix Signed-off-by: Tuan Lai <tuanl@nvidia.com> * fix bugs in hifigan code (NVIDIA#2392) Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Update setup.py (NVIDIA#2394) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * update checkpointing (NVIDIA#2396) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * byt5 unicode implementation (NVIDIA#2365) * Audio Norm (NVIDIA#2285) * add jenkins test, refactoring Signed-off-by: ekmb <ebakhturina@nvidia.com> * update test Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix new test Signed-off-by: ekmb <ebakhturina@nvidia.com> * add serial to the default normalizer, add tests Signed-off-by: ekmb <ebakhturina@nvidia.com> * manifest test added Signed-off-by: ekmb <ebakhturina@nvidia.com> * expose more params, new test cases Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix jenkins, serial clean, exclude range from cardinal Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins dollar sign format Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins dollar sign format Signed-off-by: ekmb <ebakhturina@nvidia.com> * addressed review comments Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix decimal in measure Signed-off-by: ekmb <ebakhturina@nvidia.com> * move serial in cardinal Signed-off-by: ekmb <ebakhturina@nvidia.com> * clean up Signed-off-by: ekmb <ebakhturina@nvidia.com> * update for SH zero -> oh Signed-off-by: ekmb <ebakhturina@nvidia.com> * change n_tagger default Signed-off-by: ekmb <ebakhturina@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * bumping version to 1.0.1 Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Add check for numba regardless of device Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * upper bound for webdataset Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Correct Dockerfile Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update readmes Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update README (NVIDIA#2332) Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * ddp translate GPU allocation fix (NVIDIA#2312) * fixed branch in IR tutorial Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> * ddp translate GPU allocation fix Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> * map_location instead of set_device Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Shallow fusion (NVIDIA#2315) * fixed branch in IR tutorial Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> * shallow fusion init commit Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> * debug info removed Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * [BUGFIX] Add upper bound to hydra for 1.0.x (NVIDIA#2337) * upper bound hydra Signed-off-by: ericharper <complex451@gmail.com> * upper bound hydra Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update version number Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update package version Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * sparrowhawk tests + punctuation post processing for pynini TN (NVIDIA#2320) * add jenkins test, refactoring Signed-off-by: ekmb <ebakhturina@nvidia.com> * update test Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix new test Signed-off-by: ekmb <ebakhturina@nvidia.com> * add serial to the default normalizer, add tests Signed-off-by: ekmb <ebakhturina@nvidia.com> * manifest test added Signed-off-by: ekmb <ebakhturina@nvidia.com> * expose more params, new test cases Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix jenkins, serial clean, exclude range from cardinal Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins dollar sign format Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins dollar sign format Signed-off-by: ekmb <ebakhturina@nvidia.com> * addressed review comments Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix decimal in measure Signed-off-by: ekmb <ebakhturina@nvidia.com> * move serial in cardinal Signed-off-by: ekmb <ebakhturina@nvidia.com> * sh tests init Signed-off-by: ekmb <ebakhturina@nvidia.com> * sparrowhawk container tests support added Signed-off-by: ekmb <ebakhturina@nvidia.com> * add post process to normalize.py, update tests Signed-off-by: ekmb <ebakhturina@nvidia.com> * remove duplication Signed-off-by: ekmb <ebakhturina@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update notebooks to 1.0.2 release (NVIDIA#2338) Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update ranges for omegaconf and hydra (NVIDIA#2336) * Update ranges Signed-off-by: smajumdar <titu1994@gmail.com> * Updates for Hydra and OmegaConf updates Signed-off-by: smajumdar <titu1994@gmail.com> * Style fixes Signed-off-by: smajumdar <titu1994@gmail.com> * Correct tests and revert patch for model utils Signed-off-by: smajumdar <titu1994@gmail.com> * Correct docstring Signed-off-by: smajumdar <titu1994@gmail.com> * Revert unnecessary change Signed-off-by: smajumdar <titu1994@gmail.com> * Revert unnecessary change Signed-off-by: smajumdar <titu1994@gmail.com> * Guard scheduler for None Signed-off-by: smajumdar <titu1994@gmail.com> * default to 0.0 if bpe_dropout is None Signed-off-by: ericharper <complex451@gmail.com> * Correctly log class that was restored Signed-off-by: smajumdar <titu1994@gmail.com> * Root patch *bpe_dropout Signed-off-by: smajumdar <titu1994@gmail.com> Co-authored-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update FastPitch Export (NVIDIA#2355) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * byt5 unicode implementation, first cut Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * add bytelevel tokenizer Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update out_dir to not collide (NVIDIA#2358) Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update container version to 21.05 (NVIDIA#2309) * Update container version Signed-off-by: smajumdar <titu1994@gmail.com> * Temporarily change export format of waveglow Signed-off-by: smajumdar <titu1994@gmail.com> * Add conda update for numba Signed-off-by: smajumdar <titu1994@gmail.com> * Update numba compat via global flag for strictness level `--relax_numba_compat`, remove pytorchlightning.metrics, refactor out numba utils to core, update tests Signed-off-by: smajumdar <titu1994@gmail.com> * Correct order of numba minimum verion, remove wrong flag from test Signed-off-by: smajumdar <titu1994@gmail.com> * Double test of cuda numba Signed-off-by: smajumdar <titu1994@gmail.com> * Double test of cuda numba Signed-off-by: smajumdar <titu1994@gmail.com> * Enable RNNT tests Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Text Normalization Update (NVIDIA#2356) * upper cased date support Signed-off-by: ekmb <ebakhturina@nvidia.com> * update whitelist, change roman weights Signed-off-by: ekmb <ebakhturina@nvidia.com> * docstrings, space fix, init file Signed-off-by: ekmb <ebakhturina@nvidia.com> * lgtm Signed-off-by: ekmb <ebakhturina@nvidia.com> * fraction with measure class Signed-off-by: ekmb <ebakhturina@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * address comment Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Add ASR CTC tutorial on fine-tuning on another language (NVIDIA#2346) * Add ASR CTC Language finetuning notebook Signed-off-by: smajumdar <titu1994@gmail.com> * Add to documentation Signed-off-by: smajumdar <titu1994@gmail.com> * Improve documentation Signed-off-by: smajumdar <titu1994@gmail.com> * Correct name of the dataset Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Correct colab link to notebook (NVIDIA#2366) Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * sgdqa update data directories for testing (NVIDIA#2323) * sgdqa update data directories for testing Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * fix syntax Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * check if data dir exists Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * fix Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * adding pretrained model Signed-off-by: Yang Zhang <yangzhang@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Added documentation for export() (NVIDIA#2330) * Added export document Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com> * Addressed review comments Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com> Co-authored-by: Eric Harper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update Citrinet model card info (NVIDIA#2369) * Update model card info Signed-off-by: smajumdar <titu1994@gmail.com> * Cleanup Docs Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * [NMT] Model Parallel Megatron Encoders (NVIDIA#2238) * add megatron encoder Signed-off-by: ericharper <complex451@gmail.com> * added megatron to get_nmt_tokenizer Signed-off-by: ericharper <complex451@gmail.com> * add vocab_size and hidden_size to megatron bert Signed-off-by: ericharper <complex451@gmail.com> * add megatron encoder module Signed-off-by: ericharper <complex451@gmail.com> * fixed horrible typo Signed-off-by: ericharper <complex451@gmail.com> * fix typo and add default Signed-off-by: ericharper <complex451@gmail.com> * updating nlp overrides for mp nmt Signed-off-by: ericharper <complex451@gmail.com> * move some logic back to nlpmodel from overrides Signed-off-by: ericharper <complex451@gmail.com> * add checkpoint_file property Signed-off-by: ericharper <complex451@gmail.com> * fix property Signed-off-by: ericharper <complex451@gmail.com> * num_tokentypes=0 Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * find_unused_parameters=True Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * style Signed-off-by: ericharper <complex451@gmail.com> * get instead of pop Signed-off-by: ericharper <complex451@gmail.com> * remove token type ids from megatron input example Signed-off-by: ericharper <complex451@gmail.com> * pop vocab_size Signed-off-by: ericharper <complex451@gmail.com> * fix checkpointing for model parallel Signed-off-by: ericharper <complex451@gmail.com> * fix bug in non model parallel Signed-off-by: ericharper <complex451@gmail.com> * convert cfg.trainer to dict Signed-off-by: ericharper <complex451@gmail.com> * make num_tokentypes configurable for nmt Signed-off-by: ericharper <complex451@gmail.com> * update checkpoint_file when using named megatron model in nemo Signed-off-by: ericharper <complex451@gmail.com> * make vocab_file configurable Signed-off-by: ericharper <complex451@gmail.com> * dataclass can't have mutable default Signed-off-by: ericharper <complex451@gmail.com> * style Signed-off-by: ericharper <complex451@gmail.com> * unused imports Signed-off-by: ericharper <complex451@gmail.com> * revert input example Signed-off-by: ericharper <complex451@gmail.com> * check that checkpoint version is not None Signed-off-by: ericharper <complex451@gmail.com> * add mp jenkins test Signed-off-by: ericharper <complex451@gmail.com> * update docstring Signed-off-by: ericharper <complex451@gmail.com> * add docs for pretrained encoders with nemo nmt Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Add notebook with recommendations for 8 kHz speech (NVIDIA#2326) * Added a notebook with best practices for telephony speech * Added datasets detaiils * Added training recommendations * Emptied out cells with results * Added tutorial to docs Signed-off-by: jbalam <jbalam@nvidia.com> * Addressed review comments Signed-off-by: jbalam <jbalam@nvidia.com> * Added a line to note original sampling rate of an4 Signed-off-by: jbalam <jbalam@nvidia.com> * Made changes suggested in review Signed-off-by: jbalam <jbalam@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Add FastEmit support for RNNT Losses (NVIDIA#2374) * Temp commit Signed-off-by: smajumdar <titu1994@gmail.com> * Initial code for fastemit forward pass Signed-off-by: smajumdar <titu1994@gmail.com> * Correct return reg value Signed-off-by: smajumdar <titu1994@gmail.com> * Initial cpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Try gpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Try gpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Correct few impl Signed-off-by: smajumdar <titu1994@gmail.com> * Update fastemit scaling Signed-off-by: smajumdar <titu1994@gmail.com> * Cleanup fastemit Signed-off-by: smajumdar <titu1994@gmail.com> * Finalize FastEmit regularization PR Signed-off-by: smajumdar <titu1994@gmail.com> * Refactor code to support fastemit regularization Signed-off-by: smajumdar <titu1994@gmail.com> Co-authored-by: Samuel Kriman <samuelkriman@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * byt5 unicode implementation, first cut Signed-off-by: Mike Chrzanowski <mchrzanowski@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * add bytelevel tokenizer Signed-off-by: Mike Chrzanowski <mchrzanowski@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update styling Signed-off-by: Mike Chrzanowski <mchrzanowski@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * avoid circular import Signed-off-by: Mike Chrzanowski <mchrzanowski@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * fix bugs in hifigan code (NVIDIA#2392) Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update setup.py (NVIDIA#2394) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update bytelevel_tokenizer.py Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update bytelevel_tokenizer.py Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * typo Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * missed one Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * bug fixes Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * style fix Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * bytelevelprocessor is now generic. Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * style fix Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update checkpointing (NVIDIA#2396) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * style Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * woops, didnt merge jenkinsfile the right way * add newline Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * undo changes to enja processor Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * processor selection decision fix Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * newline fix Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> Co-authored-by: Evelina <10428420+ekmb@users.noreply.github.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Aleksey Grinchuk (Oleksii Hrinchuk) <grinchuk.alexey@gmail.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Eric Harper <complex451@gmail.com> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: mchrzanowski <mchrzanowski@nvidia.com> Co-authored-by: Yang Zhang <yzhang123@users.noreply.github.com> Co-authored-by: Boris Fomitchev <borisfom@users.noreply.github.com> Co-authored-by: Jagadeesh Balam <4916480+jbalam-nv@users.noreply.github.com> Co-authored-by: Samuel Kriman <samuelkriman@gmail.com> Co-authored-by: Oktai Tatanov <oktai.tatanov@gmail.com> Co-authored-by: root <root@dgx0026.nsv.rno1.nvmetal.net> Co-authored-by: root <root@dgx0079.nsv.rno1.nvmetal.net> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Minor Fix Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Minor Fixes Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add TextNormalizationTestDataset and testing/evaluation code Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add TextNormalizationTaggerDataset and training code for tagger Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Restore from local nemo ckpts Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add TextNormalizationDecoderDataset Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add interactive mode for neural_text_normalization_test.py Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add options to do training or not for tagger/decoder Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Renamed Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Implemented setup dataloader for decoder Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Implemented training and validation for decoder Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Data augmentation for decoder training Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Config change Signed-off-by: Tuan Lai <tuanl@nvidia.com> * add blossom-ci.yml (NVIDIA#2401) Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Merge r1.1 bugfixes into main (NVIDIA#2407) * Update notebook branch and Jenkinsfile for 1.1.0 testing (NVIDIA#2378) * update branch Signed-off-by: ericharper <complex451@gmail.com> * update jenkinsfile Signed-off-by: ericharper <complex451@gmail.com> * [BUGFIX] NMT Multi-node was incorrectly computing num_replicas (NVIDIA#2380) * fix property when not using model parallel Signed-off-by: ericharper <complex451@gmail.com> * fix property when not using model parallel Signed-off-by: ericharper <complex451@gmail.com> * add debug statement Signed-off-by: ericharper <complex451@gmail.com> * add debug statement Signed-off-by: ericharper <complex451@gmail.com> * instantiate with NLPDDPPlugin with num_nodes from trainer config Signed-off-by: ericharper <complex451@gmail.com> * Update ASR scripts for tokenizer building and tarred dataset building (NVIDIA#2381) * Update ASR scripts for tokenizer building and tarred dataset building Signed-off-by: smajumdar <titu1994@gmail.com> * Update container Signed-off-by: smajumdar <titu1994@gmail.com> * Add STT Zh Citrinet 1024 Gamma 0.25 model Signed-off-by: smajumdar <titu1994@gmail.com> * Update notebook (NVIDIA#2391) Signed-off-by: smajumdar <titu1994@gmail.com> * ASR Notebooks fix for 1.1.0 (NVIDIA#2395) * nb fix for spring clean Signed-off-by: fayejf <fayejf07@gmail.com> * remove outdated instruction Signed-off-by: fayejf <fayejf07@gmail.com> * Mean normalization (NVIDIA#2397) * norm embeddings Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * move to utils Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * Bugfix adaptive spec augment time masking (NVIDIA#2398) * bugfix adaptive spec augment Signed-off-by: smajumdar <titu1994@gmail.com> * Revert freq mask guard Signed-off-by: smajumdar <titu1994@gmail.com> * Revert freq mask guard Signed-off-by: smajumdar <titu1994@gmail.com> * Remove static time width clamping Signed-off-by: smajumdar <titu1994@gmail.com> * Correct typos and issues with notebooks (NVIDIA#2402) * Fix Primer notebook Signed-off-by: smajumdar <titu1994@gmail.com> * Typo Signed-off-by: smajumdar <titu1994@gmail.com> * remove accelerator=DDP in tutorial notebooks to avoid errors. (NVIDIA#2403) Signed-off-by: Hoo Chang Shin <hshin@nvidia.com> Co-authored-by: Hoo Chang Shin <hshin@nvidia.com> * style Signed-off-by: ericharper <complex451@gmail.com> * update jenkins branch Signed-off-by: ericharper <complex451@gmail.com> * update notebook branch to main Signed-off-by: ericharper <complex451@gmail.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: fayejf <36722593+fayejf@users.noreply.github.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: khcs <khcs@users.noreply.github.com> Co-authored-by: Hoo Chang Shin <hshin@nvidia.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Remove unused imports Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add initial doc for text_normalization Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Fixed imports warnings Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Minor Fix Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Renamed Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Allowed duplex modes Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Minor Fix Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add docs for duplex_text_normalization_train and duplex_text_normalization_test Signed-off-by: Tuan Lai <tuanl@nvidia.com> * docstrings for model codes + minor fix Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add more comments and doc strings Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add doc for datasets + Use time.perf_counter() Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add code for preprocessing Google TN data Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add more docs and comments + Minor Fixes Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add more licenses + Fixed comments + Minors Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Moved evaluation logic to DuplexTextNormalizationModel Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add logging errors Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Updated validation code of tagger + Minors Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Also write tag preds to log file Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add data augmentation for tagger dataset Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Added experimental decorators Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Updated docs Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Updated duplex_tn_config.yaml Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Compute token precision of tagger using NeMo metrics Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Fixed saving issue when using ddp accelerator Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Refactoring Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add option to keep punctuations in TextNormalizationTestDataset Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Changes to input preprocessing + decoder's postprocessing Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Fixed styles + Add references Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Renamed examples/nlp/duplex_text_normalization/utils.py to helpers.py Signed-off-by: Tuan Lai <tuanl@nvidia.com> Co-authored-by: Jagadeesh Balam <4916480+jbalam-nv@users.noreply.github.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: Samuel Kriman <samuelkriman@gmail.com> Co-authored-by: Oktai Tatanov <oktai.tatanov@gmail.com> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: Mike Chrzanowski <mike.chrzanowski0@gmail.com> Co-authored-by: Evelina <10428420+ekmb@users.noreply.github.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Aleksey Grinchuk (Oleksii Hrinchuk) <grinchuk.alexey@gmail.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Eric Harper <complex451@gmail.com> Co-authored-by: mchrzanowski <mchrzanowski@nvidia.com> Co-authored-by: Yang Zhang <yzhang123@users.noreply.github.com> Co-authored-by: Boris Fomitchev <borisfom@users.noreply.github.com> Co-authored-by: root <root@dgx0026.nsv.rno1.nvmetal.net> Co-authored-by: root <root@dgx0079.nsv.rno1.nvmetal.net> Co-authored-by: fayejf <36722593+fayejf@users.noreply.github.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: khcs <khcs@users.noreply.github.com> Co-authored-by: Hoo Chang Shin <hshin@nvidia.com> Signed-off-by: Ghasem Pasandi <gpasandi@nvidia.com>
2 tasks
fayejf
added a commit
that referenced
this pull request
Jul 16, 2021
* Add notebook with recommendations for 8 kHz speech (#2326) * Added a notebook with best practices for telephony speech * Added datasets detaiils * Added training recommendations * Emptied out cells with results * Added tutorial to docs Signed-off-by: jbalam <jbalam@nvidia.com> * Addressed review comments Signed-off-by: jbalam <jbalam@nvidia.com> * Added a line to note original sampling rate of an4 Signed-off-by: jbalam <jbalam@nvidia.com> * Made changes suggested in review Signed-off-by: jbalam <jbalam@nvidia.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add FastEmit support for RNNT Losses (#2374) * Temp commit Signed-off-by: smajumdar <titu1994@gmail.com> * Initial code for fastemit forward pass Signed-off-by: smajumdar <titu1994@gmail.com> * Correct return reg value Signed-off-by: smajumdar <titu1994@gmail.com> * Initial cpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Try gpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Try gpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Correct few impl Signed-off-by: smajumdar <titu1994@gmail.com> * Update fastemit scaling Signed-off-by: smajumdar <titu1994@gmail.com> * Cleanup fastemit Signed-off-by: smajumdar <titu1994@gmail.com> * Finalize FastEmit regularization PR Signed-off-by: smajumdar <titu1994@gmail.com> * Refactor code to support fastemit regularization Signed-off-by: smajumdar <titu1994@gmail.com> Co-authored-by: Samuel Kriman <samuelkriman@gmail.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Implement inference functions of TN models Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Minor Fix Signed-off-by: Tuan Lai <tuanl@nvidia.com> * fix bugs in hifigan code (#2392) Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Update setup.py (#2394) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * update checkpointing (#2396) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * byt5 unicode implementation (#2365) * Audio Norm (#2285) * add jenkins test, refactoring Signed-off-by: ekmb <ebakhturina@nvidia.com> * update test Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix new test Signed-off-by: ekmb <ebakhturina@nvidia.com> * add serial to the default normalizer, add tests Signed-off-by: ekmb <ebakhturina@nvidia.com> * manifest test added Signed-off-by: ekmb <ebakhturina@nvidia.com> * expose more params, new test cases Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix jenkins, serial clean, exclude range from cardinal Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins dollar sign format Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins dollar sign format Signed-off-by: ekmb <ebakhturina@nvidia.com> * addressed review comments Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix decimal in measure Signed-off-by: ekmb <ebakhturina@nvidia.com> * move serial in cardinal Signed-off-by: ekmb <ebakhturina@nvidia.com> * clean up Signed-off-by: ekmb <ebakhturina@nvidia.com> * update for SH zero -> oh Signed-off-by: ekmb <ebakhturina@nvidia.com> * change n_tagger default Signed-off-by: ekmb <ebakhturina@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * bumping version to 1.0.1 Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Add check for numba regardless of device Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * upper bound for webdataset Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Correct Dockerfile Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update readmes Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update README (#2332) Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * ddp translate GPU allocation fix (#2312) * fixed branch in IR tutorial Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> * ddp translate GPU allocation fix Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> * map_location instead of set_device Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Shallow fusion (#2315) * fixed branch in IR tutorial Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> * shallow fusion init commit Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> * debug info removed Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * [BUGFIX] Add upper bound to hydra for 1.0.x (#2337) * upper bound hydra Signed-off-by: ericharper <complex451@gmail.com> * upper bound hydra Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update version number Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update package version Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * sparrowhawk tests + punctuation post processing for pynini TN (#2320) * add jenkins test, refactoring Signed-off-by: ekmb <ebakhturina@nvidia.com> * update test Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix new test Signed-off-by: ekmb <ebakhturina@nvidia.com> * add serial to the default normalizer, add tests Signed-off-by: ekmb <ebakhturina@nvidia.com> * manifest test added Signed-off-by: ekmb <ebakhturina@nvidia.com> * expose more params, new test cases Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix jenkins, serial clean, exclude range from cardinal Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins dollar sign format Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins dollar sign format Signed-off-by: ekmb <ebakhturina@nvidia.com> * addressed review comments Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix decimal in measure Signed-off-by: ekmb <ebakhturina@nvidia.com> * move serial in cardinal Signed-off-by: ekmb <ebakhturina@nvidia.com> * sh tests init Signed-off-by: ekmb <ebakhturina@nvidia.com> * sparrowhawk container tests support added Signed-off-by: ekmb <ebakhturina@nvidia.com> * add post process to normalize.py, update tests Signed-off-by: ekmb <ebakhturina@nvidia.com> * remove duplication Signed-off-by: ekmb <ebakhturina@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update notebooks to 1.0.2 release (#2338) Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update ranges for omegaconf and hydra (#2336) * Update ranges Signed-off-by: smajumdar <titu1994@gmail.com> * Updates for Hydra and OmegaConf updates Signed-off-by: smajumdar <titu1994@gmail.com> * Style fixes Signed-off-by: smajumdar <titu1994@gmail.com> * Correct tests and revert patch for model utils Signed-off-by: smajumdar <titu1994@gmail.com> * Correct docstring Signed-off-by: smajumdar <titu1994@gmail.com> * Revert unnecessary change Signed-off-by: smajumdar <titu1994@gmail.com> * Revert unnecessary change Signed-off-by: smajumdar <titu1994@gmail.com> * Guard scheduler for None Signed-off-by: smajumdar <titu1994@gmail.com> * default to 0.0 if bpe_dropout is None Signed-off-by: ericharper <complex451@gmail.com> * Correctly log class that was restored Signed-off-by: smajumdar <titu1994@gmail.com> * Root patch *bpe_dropout Signed-off-by: smajumdar <titu1994@gmail.com> Co-authored-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update FastPitch Export (#2355) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * byt5 unicode implementation, first cut Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * add bytelevel tokenizer Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update out_dir to not collide (#2358) Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update container version to 21.05 (#2309) * Update container version Signed-off-by: smajumdar <titu1994@gmail.com> * Temporarily change export format of waveglow Signed-off-by: smajumdar <titu1994@gmail.com> * Add conda update for numba Signed-off-by: smajumdar <titu1994@gmail.com> * Update numba compat via global flag for strictness level `--relax_numba_compat`, remove pytorchlightning.metrics, refactor out numba utils to core, update tests Signed-off-by: smajumdar <titu1994@gmail.com> * Correct order of numba minimum verion, remove wrong flag from test Signed-off-by: smajumdar <titu1994@gmail.com> * Double test of cuda numba Signed-off-by: smajumdar <titu1994@gmail.com> * Double test of cuda numba Signed-off-by: smajumdar <titu1994@gmail.com> * Enable RNNT tests Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Text Normalization Update (#2356) * upper cased date support Signed-off-by: ekmb <ebakhturina@nvidia.com> * update whitelist, change roman weights Signed-off-by: ekmb <ebakhturina@nvidia.com> * docstrings, space fix, init file Signed-off-by: ekmb <ebakhturina@nvidia.com> * lgtm Signed-off-by: ekmb <ebakhturina@nvidia.com> * fraction with measure class Signed-off-by: ekmb <ebakhturina@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * address comment Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Add ASR CTC tutorial on fine-tuning on another language (#2346) * Add ASR CTC Language finetuning notebook Signed-off-by: smajumdar <titu1994@gmail.com> * Add to documentation Signed-off-by: smajumdar <titu1994@gmail.com> * Improve documentation Signed-off-by: smajumdar <titu1994@gmail.com> * Correct name of the dataset Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Correct colab link to notebook (#2366) Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * sgdqa update data directories for testing (#2323) * sgdqa update data directories for testing Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * fix syntax Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * check if data dir exists Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * fix Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * adding pretrained model Signed-off-by: Yang Zhang <yangzhang@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Added documentation for export() (#2330) * Added export document Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com> * Addressed review comments Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com> Co-authored-by: Eric Harper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update Citrinet model card info (#2369) * Update model card info Signed-off-by: smajumdar <titu1994@gmail.com> * Cleanup Docs Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * [NMT] Model Parallel Megatron Encoders (#2238) * add megatron encoder Signed-off-by: ericharper <complex451@gmail.com> * added megatron to get_nmt_tokenizer Signed-off-by: ericharper <complex451@gmail.com> * add vocab_size and hidden_size to megatron bert Signed-off-by: ericharper <complex451@gmail.com> * add megatron encoder module Signed-off-by: ericharper <complex451@gmail.com> * fixed horrible typo Signed-off-by: ericharper <complex451@gmail.com> * fix typo and add default Signed-off-by: ericharper <complex451@gmail.com> * updating nlp overrides for mp nmt Signed-off-by: ericharper <complex451@gmail.com> * move some logic back to nlpmodel from overrides Signed-off-by: ericharper <complex451@gmail.com> * add checkpoint_file property Signed-off-by: ericharper <complex451@gmail.com> * fix property Signed-off-by: ericharper <complex451@gmail.com> * num_tokentypes=0 Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * find_unused_parameters=True Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * style Signed-off-by: ericharper <complex451@gmail.com> * get instead of pop Signed-off-by: ericharper <complex451@gmail.com> * remove token type ids from megatron input example Signed-off-by: ericharper <complex451@gmail.com> * pop vocab_size Signed-off-by: ericharper <complex451@gmail.com> * fix checkpointing for model parallel Signed-off-by: ericharper <complex451@gmail.com> * fix bug in non model parallel Signed-off-by: ericharper <complex451@gmail.com> * convert cfg.trainer to dict Signed-off-by: ericharper <complex451@gmail.com> * make num_tokentypes configurable for nmt Signed-off-by: ericharper <complex451@gmail.com> * update checkpoint_file when using named megatron model in nemo Signed-off-by: ericharper <complex451@gmail.com> * make vocab_file configurable Signed-off-by: ericharper <complex451@gmail.com> * dataclass can't have mutable default Signed-off-by: ericharper <complex451@gmail.com> * style Signed-off-by: ericharper <complex451@gmail.com> * unused imports Signed-off-by: ericharper <complex451@gmail.com> * revert input example Signed-off-by: ericharper <complex451@gmail.com> * check that checkpoint version is not None Signed-off-by: ericharper <complex451@gmail.com> * add mp jenkins test Signed-off-by: ericharper <complex451@gmail.com> * update docstring Signed-off-by: ericharper <complex451@gmail.com> * add docs for pretrained encoders with nemo nmt Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Add notebook with recommendations for 8 kHz speech (#2326) * Added a notebook with best practices for telephony speech * Added datasets detaiils * Added training recommendations * Emptied out cells with results * Added tutorial to docs Signed-off-by: jbalam <jbalam@nvidia.com> * Addressed review comments Signed-off-by: jbalam <jbalam@nvidia.com> * Added a line to note original sampling rate of an4 Signed-off-by: jbalam <jbalam@nvidia.com> * Made changes suggested in review Signed-off-by: jbalam <jbalam@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Add FastEmit support for RNNT Losses (#2374) * Temp commit Signed-off-by: smajumdar <titu1994@gmail.com> * Initial code for fastemit forward pass Signed-off-by: smajumdar <titu1994@gmail.com> * Correct return reg value Signed-off-by: smajumdar <titu1994@gmail.com> * Initial cpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Try gpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Try gpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Correct few impl Signed-off-by: smajumdar <titu1994@gmail.com> * Update fastemit scaling Signed-off-by: smajumdar <titu1994@gmail.com> * Cleanup fastemit Signed-off-by: smajumdar <titu1994@gmail.com> * Finalize FastEmit regularization PR Signed-off-by: smajumdar <titu1994@gmail.com> * Refactor code to support fastemit regularization Signed-off-by: smajumdar <titu1994@gmail.com> Co-authored-by: Samuel Kriman <samuelkriman@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * byt5 unicode implementation, first cut Signed-off-by: Mike Chrzanowski <mchrzanowski@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * add bytelevel tokenizer Signed-off-by: Mike Chrzanowski <mchrzanowski@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update styling Signed-off-by: Mike Chrzanowski <mchrzanowski@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * avoid circular import Signed-off-by: Mike Chrzanowski <mchrzanowski@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * fix bugs in hifigan code (#2392) Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update setup.py (#2394) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update bytelevel_tokenizer.py Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update bytelevel_tokenizer.py Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * typo Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * missed one Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * bug fixes Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * style fix Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * bytelevelprocessor is now generic. Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * style fix Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update checkpointing (#2396) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * style Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * woops, didnt merge jenkinsfile the right way * add newline Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * undo changes to enja processor Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * processor selection decision fix Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * newline fix Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> Co-authored-by: Evelina <10428420+ekmb@users.noreply.github.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Aleksey Grinchuk (Oleksii Hrinchuk) <grinchuk.alexey@gmail.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Eric Harper <complex451@gmail.com> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: mchrzanowski <mchrzanowski@nvidia.com> Co-authored-by: Yang Zhang <yzhang123@users.noreply.github.com> Co-authored-by: Boris Fomitchev <borisfom@users.noreply.github.com> Co-authored-by: Jagadeesh Balam <4916480+jbalam-nv@users.noreply.github.com> Co-authored-by: Samuel Kriman <samuelkriman@gmail.com> Co-authored-by: Oktai Tatanov <oktai.tatanov@gmail.com> Co-authored-by: root <root@dgx0026.nsv.rno1.nvmetal.net> Co-authored-by: root <root@dgx0079.nsv.rno1.nvmetal.net> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Minor Fix Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Minor Fixes Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add TextNormalizationTestDataset and testing/evaluation code Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add TextNormalizationTaggerDataset and training code for tagger Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Restore from local nemo ckpts Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add TextNormalizationDecoderDataset Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add interactive mode for neural_text_normalization_test.py Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add options to do training or not for tagger/decoder Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Renamed Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Implemented setup dataloader for decoder Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Implemented training and validation for decoder Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Data augmentation for decoder training Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Config change Signed-off-by: Tuan Lai <tuanl@nvidia.com> * add blossom-ci.yml (#2401) Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Merge r1.1 bugfixes into main (#2407) * Update notebook branch and Jenkinsfile for 1.1.0 testing (#2378) * update branch Signed-off-by: ericharper <complex451@gmail.com> * update jenkinsfile Signed-off-by: ericharper <complex451@gmail.com> * [BUGFIX] NMT Multi-node was incorrectly computing num_replicas (#2380) * fix property when not using model parallel Signed-off-by: ericharper <complex451@gmail.com> * fix property when not using model parallel Signed-off-by: ericharper <complex451@gmail.com> * add debug statement Signed-off-by: ericharper <complex451@gmail.com> * add debug statement Signed-off-by: ericharper <complex451@gmail.com> * instantiate with NLPDDPPlugin with num_nodes from trainer config Signed-off-by: ericharper <complex451@gmail.com> * Update ASR scripts for tokenizer building and tarred dataset building (#2381) * Update ASR scripts for tokenizer building and tarred dataset building Signed-off-by: smajumdar <titu1994@gmail.com> * Update container Signed-off-by: smajumdar <titu1994@gmail.com> * Add STT Zh Citrinet 1024 Gamma 0.25 model Signed-off-by: smajumdar <titu1994@gmail.com> * Update notebook (#2391) Signed-off-by: smajumdar <titu1994@gmail.com> * ASR Notebooks fix for 1.1.0 (#2395) * nb fix for spring clean Signed-off-by: fayejf <fayejf07@gmail.com> * remove outdated instruction Signed-off-by: fayejf <fayejf07@gmail.com> * Mean normalization (#2397) * norm embeddings Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * move to utils Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * Bugfix adaptive spec augment time masking (#2398) * bugfix adaptive spec augment Signed-off-by: smajumdar <titu1994@gmail.com> * Revert freq mask guard Signed-off-by: smajumdar <titu1994@gmail.com> * Revert freq mask guard Signed-off-by: smajumdar <titu1994@gmail.com> * Remove static time width clamping Signed-off-by: smajumdar <titu1994@gmail.com> * Correct typos and issues with notebooks (#2402) * Fix Primer notebook Signed-off-by: smajumdar <titu1994@gmail.com> * Typo Signed-off-by: smajumdar <titu1994@gmail.com> * remove accelerator=DDP in tutorial notebooks to avoid errors. (#2403) Signed-off-by: Hoo Chang Shin <hshin@nvidia.com> Co-authored-by: Hoo Chang Shin <hshin@nvidia.com> * style Signed-off-by: ericharper <complex451@gmail.com> * update jenkins branch Signed-off-by: ericharper <complex451@gmail.com> * update notebook branch to main Signed-off-by: ericharper <complex451@gmail.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: fayejf <36722593+fayejf@users.noreply.github.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: khcs <khcs@users.noreply.github.com> Co-authored-by: Hoo Chang Shin <hshin@nvidia.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Remove unused imports Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add initial doc for text_normalization Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Fixed imports warnings Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Minor Fix Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Renamed Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Allowed duplex modes Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Minor Fix Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add docs for duplex_text_normalization_train and duplex_text_normalization_test Signed-off-by: Tuan Lai <tuanl@nvidia.com> * docstrings for model codes + minor fix Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add more comments and doc strings Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add doc for datasets + Use time.perf_counter() Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add code for preprocessing Google TN data Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add more docs and comments + Minor Fixes Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add more licenses + Fixed comments + Minors Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Moved evaluation logic to DuplexTextNormalizationModel Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add logging errors Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Updated validation code of tagger + Minors Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Also write tag preds to log file Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add data augmentation for tagger dataset Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Added experimental decorators Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Updated docs Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Updated duplex_tn_config.yaml Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Compute token precision of tagger using NeMo metrics Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Fixed saving issue when using ddp accelerator Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Refactoring Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add option to keep punctuations in TextNormalizationTestDataset Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Changes to input preprocessing + decoder's postprocessing Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Fixed styles + Add references Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Renamed examples/nlp/duplex_text_normalization/utils.py to helpers.py Signed-off-by: Tuan Lai <tuanl@nvidia.com> Co-authored-by: Jagadeesh Balam <4916480+jbalam-nv@users.noreply.github.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: Samuel Kriman <samuelkriman@gmail.com> Co-authored-by: Oktai Tatanov <oktai.tatanov@gmail.com> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: Mike Chrzanowski <mike.chrzanowski0@gmail.com> Co-authored-by: Evelina <10428420+ekmb@users.noreply.github.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Aleksey Grinchuk (Oleksii Hrinchuk) <grinchuk.alexey@gmail.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Eric Harper <complex451@gmail.com> Co-authored-by: mchrzanowski <mchrzanowski@nvidia.com> Co-authored-by: Yang Zhang <yzhang123@users.noreply.github.com> Co-authored-by: Boris Fomitchev <borisfom@users.noreply.github.com> Co-authored-by: root <root@dgx0026.nsv.rno1.nvmetal.net> Co-authored-by: root <root@dgx0079.nsv.rno1.nvmetal.net> Co-authored-by: fayejf <36722593+fayejf@users.noreply.github.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: khcs <khcs@users.noreply.github.com> Co-authored-by: Hoo Chang Shin <hshin@nvidia.com>
titu1994
added a commit
to titu1994/NeMo
that referenced
this pull request
Jul 20, 2021
* Add notebook with recommendations for 8 kHz speech (NVIDIA#2326) * Added a notebook with best practices for telephony speech * Added datasets detaiils * Added training recommendations * Emptied out cells with results * Added tutorial to docs Signed-off-by: jbalam <jbalam@nvidia.com> * Addressed review comments Signed-off-by: jbalam <jbalam@nvidia.com> * Added a line to note original sampling rate of an4 Signed-off-by: jbalam <jbalam@nvidia.com> * Made changes suggested in review Signed-off-by: jbalam <jbalam@nvidia.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add FastEmit support for RNNT Losses (NVIDIA#2374) * Temp commit Signed-off-by: smajumdar <titu1994@gmail.com> * Initial code for fastemit forward pass Signed-off-by: smajumdar <titu1994@gmail.com> * Correct return reg value Signed-off-by: smajumdar <titu1994@gmail.com> * Initial cpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Try gpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Try gpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Correct few impl Signed-off-by: smajumdar <titu1994@gmail.com> * Update fastemit scaling Signed-off-by: smajumdar <titu1994@gmail.com> * Cleanup fastemit Signed-off-by: smajumdar <titu1994@gmail.com> * Finalize FastEmit regularization PR Signed-off-by: smajumdar <titu1994@gmail.com> * Refactor code to support fastemit regularization Signed-off-by: smajumdar <titu1994@gmail.com> Co-authored-by: Samuel Kriman <samuelkriman@gmail.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Implement inference functions of TN models Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Minor Fix Signed-off-by: Tuan Lai <tuanl@nvidia.com> * fix bugs in hifigan code (NVIDIA#2392) Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Update setup.py (NVIDIA#2394) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * update checkpointing (NVIDIA#2396) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * byt5 unicode implementation (NVIDIA#2365) * Audio Norm (NVIDIA#2285) * add jenkins test, refactoring Signed-off-by: ekmb <ebakhturina@nvidia.com> * update test Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix new test Signed-off-by: ekmb <ebakhturina@nvidia.com> * add serial to the default normalizer, add tests Signed-off-by: ekmb <ebakhturina@nvidia.com> * manifest test added Signed-off-by: ekmb <ebakhturina@nvidia.com> * expose more params, new test cases Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix jenkins, serial clean, exclude range from cardinal Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins dollar sign format Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins dollar sign format Signed-off-by: ekmb <ebakhturina@nvidia.com> * addressed review comments Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix decimal in measure Signed-off-by: ekmb <ebakhturina@nvidia.com> * move serial in cardinal Signed-off-by: ekmb <ebakhturina@nvidia.com> * clean up Signed-off-by: ekmb <ebakhturina@nvidia.com> * update for SH zero -> oh Signed-off-by: ekmb <ebakhturina@nvidia.com> * change n_tagger default Signed-off-by: ekmb <ebakhturina@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * bumping version to 1.0.1 Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Add check for numba regardless of device Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * upper bound for webdataset Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Correct Dockerfile Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update readmes Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update README (NVIDIA#2332) Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * ddp translate GPU allocation fix (NVIDIA#2312) * fixed branch in IR tutorial Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> * ddp translate GPU allocation fix Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> * map_location instead of set_device Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Shallow fusion (NVIDIA#2315) * fixed branch in IR tutorial Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> * shallow fusion init commit Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> * debug info removed Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * [BUGFIX] Add upper bound to hydra for 1.0.x (NVIDIA#2337) * upper bound hydra Signed-off-by: ericharper <complex451@gmail.com> * upper bound hydra Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update version number Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update package version Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * sparrowhawk tests + punctuation post processing for pynini TN (NVIDIA#2320) * add jenkins test, refactoring Signed-off-by: ekmb <ebakhturina@nvidia.com> * update test Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix new test Signed-off-by: ekmb <ebakhturina@nvidia.com> * add serial to the default normalizer, add tests Signed-off-by: ekmb <ebakhturina@nvidia.com> * manifest test added Signed-off-by: ekmb <ebakhturina@nvidia.com> * expose more params, new test cases Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix jenkins, serial clean, exclude range from cardinal Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins dollar sign format Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins dollar sign format Signed-off-by: ekmb <ebakhturina@nvidia.com> * addressed review comments Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix decimal in measure Signed-off-by: ekmb <ebakhturina@nvidia.com> * move serial in cardinal Signed-off-by: ekmb <ebakhturina@nvidia.com> * sh tests init Signed-off-by: ekmb <ebakhturina@nvidia.com> * sparrowhawk container tests support added Signed-off-by: ekmb <ebakhturina@nvidia.com> * add post process to normalize.py, update tests Signed-off-by: ekmb <ebakhturina@nvidia.com> * remove duplication Signed-off-by: ekmb <ebakhturina@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update notebooks to 1.0.2 release (NVIDIA#2338) Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update ranges for omegaconf and hydra (NVIDIA#2336) * Update ranges Signed-off-by: smajumdar <titu1994@gmail.com> * Updates for Hydra and OmegaConf updates Signed-off-by: smajumdar <titu1994@gmail.com> * Style fixes Signed-off-by: smajumdar <titu1994@gmail.com> * Correct tests and revert patch for model utils Signed-off-by: smajumdar <titu1994@gmail.com> * Correct docstring Signed-off-by: smajumdar <titu1994@gmail.com> * Revert unnecessary change Signed-off-by: smajumdar <titu1994@gmail.com> * Revert unnecessary change Signed-off-by: smajumdar <titu1994@gmail.com> * Guard scheduler for None Signed-off-by: smajumdar <titu1994@gmail.com> * default to 0.0 if bpe_dropout is None Signed-off-by: ericharper <complex451@gmail.com> * Correctly log class that was restored Signed-off-by: smajumdar <titu1994@gmail.com> * Root patch *bpe_dropout Signed-off-by: smajumdar <titu1994@gmail.com> Co-authored-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update FastPitch Export (NVIDIA#2355) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * byt5 unicode implementation, first cut Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * add bytelevel tokenizer Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update out_dir to not collide (NVIDIA#2358) Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update container version to 21.05 (NVIDIA#2309) * Update container version Signed-off-by: smajumdar <titu1994@gmail.com> * Temporarily change export format of waveglow Signed-off-by: smajumdar <titu1994@gmail.com> * Add conda update for numba Signed-off-by: smajumdar <titu1994@gmail.com> * Update numba compat via global flag for strictness level `--relax_numba_compat`, remove pytorchlightning.metrics, refactor out numba utils to core, update tests Signed-off-by: smajumdar <titu1994@gmail.com> * Correct order of numba minimum verion, remove wrong flag from test Signed-off-by: smajumdar <titu1994@gmail.com> * Double test of cuda numba Signed-off-by: smajumdar <titu1994@gmail.com> * Double test of cuda numba Signed-off-by: smajumdar <titu1994@gmail.com> * Enable RNNT tests Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Text Normalization Update (NVIDIA#2356) * upper cased date support Signed-off-by: ekmb <ebakhturina@nvidia.com> * update whitelist, change roman weights Signed-off-by: ekmb <ebakhturina@nvidia.com> * docstrings, space fix, init file Signed-off-by: ekmb <ebakhturina@nvidia.com> * lgtm Signed-off-by: ekmb <ebakhturina@nvidia.com> * fraction with measure class Signed-off-by: ekmb <ebakhturina@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * address comment Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Add ASR CTC tutorial on fine-tuning on another language (NVIDIA#2346) * Add ASR CTC Language finetuning notebook Signed-off-by: smajumdar <titu1994@gmail.com> * Add to documentation Signed-off-by: smajumdar <titu1994@gmail.com> * Improve documentation Signed-off-by: smajumdar <titu1994@gmail.com> * Correct name of the dataset Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Correct colab link to notebook (NVIDIA#2366) Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * sgdqa update data directories for testing (NVIDIA#2323) * sgdqa update data directories for testing Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * fix syntax Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * check if data dir exists Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * fix Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * adding pretrained model Signed-off-by: Yang Zhang <yangzhang@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Added documentation for export() (NVIDIA#2330) * Added export document Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com> * Addressed review comments Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com> Co-authored-by: Eric Harper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update Citrinet model card info (NVIDIA#2369) * Update model card info Signed-off-by: smajumdar <titu1994@gmail.com> * Cleanup Docs Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * [NMT] Model Parallel Megatron Encoders (NVIDIA#2238) * add megatron encoder Signed-off-by: ericharper <complex451@gmail.com> * added megatron to get_nmt_tokenizer Signed-off-by: ericharper <complex451@gmail.com> * add vocab_size and hidden_size to megatron bert Signed-off-by: ericharper <complex451@gmail.com> * add megatron encoder module Signed-off-by: ericharper <complex451@gmail.com> * fixed horrible typo Signed-off-by: ericharper <complex451@gmail.com> * fix typo and add default Signed-off-by: ericharper <complex451@gmail.com> * updating nlp overrides for mp nmt Signed-off-by: ericharper <complex451@gmail.com> * move some logic back to nlpmodel from overrides Signed-off-by: ericharper <complex451@gmail.com> * add checkpoint_file property Signed-off-by: ericharper <complex451@gmail.com> * fix property Signed-off-by: ericharper <complex451@gmail.com> * num_tokentypes=0 Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * find_unused_parameters=True Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * style Signed-off-by: ericharper <complex451@gmail.com> * get instead of pop Signed-off-by: ericharper <complex451@gmail.com> * remove token type ids from megatron input example Signed-off-by: ericharper <complex451@gmail.com> * pop vocab_size Signed-off-by: ericharper <complex451@gmail.com> * fix checkpointing for model parallel Signed-off-by: ericharper <complex451@gmail.com> * fix bug in non model parallel Signed-off-by: ericharper <complex451@gmail.com> * convert cfg.trainer to dict Signed-off-by: ericharper <complex451@gmail.com> * make num_tokentypes configurable for nmt Signed-off-by: ericharper <complex451@gmail.com> * update checkpoint_file when using named megatron model in nemo Signed-off-by: ericharper <complex451@gmail.com> * make vocab_file configurable Signed-off-by: ericharper <complex451@gmail.com> * dataclass can't have mutable default Signed-off-by: ericharper <complex451@gmail.com> * style Signed-off-by: ericharper <complex451@gmail.com> * unused imports Signed-off-by: ericharper <complex451@gmail.com> * revert input example Signed-off-by: ericharper <complex451@gmail.com> * check that checkpoint version is not None Signed-off-by: ericharper <complex451@gmail.com> * add mp jenkins test Signed-off-by: ericharper <complex451@gmail.com> * update docstring Signed-off-by: ericharper <complex451@gmail.com> * add docs for pretrained encoders with nemo nmt Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Add notebook with recommendations for 8 kHz speech (NVIDIA#2326) * Added a notebook with best practices for telephony speech * Added datasets detaiils * Added training recommendations * Emptied out cells with results * Added tutorial to docs Signed-off-by: jbalam <jbalam@nvidia.com> * Addressed review comments Signed-off-by: jbalam <jbalam@nvidia.com> * Added a line to note original sampling rate of an4 Signed-off-by: jbalam <jbalam@nvidia.com> * Made changes suggested in review Signed-off-by: jbalam <jbalam@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Add FastEmit support for RNNT Losses (NVIDIA#2374) * Temp commit Signed-off-by: smajumdar <titu1994@gmail.com> * Initial code for fastemit forward pass Signed-off-by: smajumdar <titu1994@gmail.com> * Correct return reg value Signed-off-by: smajumdar <titu1994@gmail.com> * Initial cpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Try gpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Try gpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Correct few impl Signed-off-by: smajumdar <titu1994@gmail.com> * Update fastemit scaling Signed-off-by: smajumdar <titu1994@gmail.com> * Cleanup fastemit Signed-off-by: smajumdar <titu1994@gmail.com> * Finalize FastEmit regularization PR Signed-off-by: smajumdar <titu1994@gmail.com> * Refactor code to support fastemit regularization Signed-off-by: smajumdar <titu1994@gmail.com> Co-authored-by: Samuel Kriman <samuelkriman@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * byt5 unicode implementation, first cut Signed-off-by: Mike Chrzanowski <mchrzanowski@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * add bytelevel tokenizer Signed-off-by: Mike Chrzanowski <mchrzanowski@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update styling Signed-off-by: Mike Chrzanowski <mchrzanowski@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * avoid circular import Signed-off-by: Mike Chrzanowski <mchrzanowski@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * fix bugs in hifigan code (NVIDIA#2392) Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update setup.py (NVIDIA#2394) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update bytelevel_tokenizer.py Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update bytelevel_tokenizer.py Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * typo Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * missed one Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * bug fixes Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * style fix Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * bytelevelprocessor is now generic. Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * style fix Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update checkpointing (NVIDIA#2396) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * style Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * woops, didnt merge jenkinsfile the right way * add newline Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * undo changes to enja processor Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * processor selection decision fix Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * newline fix Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> Co-authored-by: Evelina <10428420+ekmb@users.noreply.github.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Aleksey Grinchuk (Oleksii Hrinchuk) <grinchuk.alexey@gmail.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Eric Harper <complex451@gmail.com> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: mchrzanowski <mchrzanowski@nvidia.com> Co-authored-by: Yang Zhang <yzhang123@users.noreply.github.com> Co-authored-by: Boris Fomitchev <borisfom@users.noreply.github.com> Co-authored-by: Jagadeesh Balam <4916480+jbalam-nv@users.noreply.github.com> Co-authored-by: Samuel Kriman <samuelkriman@gmail.com> Co-authored-by: Oktai Tatanov <oktai.tatanov@gmail.com> Co-authored-by: root <root@dgx0026.nsv.rno1.nvmetal.net> Co-authored-by: root <root@dgx0079.nsv.rno1.nvmetal.net> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Minor Fix Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Minor Fixes Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add TextNormalizationTestDataset and testing/evaluation code Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add TextNormalizationTaggerDataset and training code for tagger Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Restore from local nemo ckpts Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add TextNormalizationDecoderDataset Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add interactive mode for neural_text_normalization_test.py Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add options to do training or not for tagger/decoder Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Renamed Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Implemented setup dataloader for decoder Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Implemented training and validation for decoder Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Data augmentation for decoder training Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Config change Signed-off-by: Tuan Lai <tuanl@nvidia.com> * add blossom-ci.yml (NVIDIA#2401) Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Merge r1.1 bugfixes into main (NVIDIA#2407) * Update notebook branch and Jenkinsfile for 1.1.0 testing (NVIDIA#2378) * update branch Signed-off-by: ericharper <complex451@gmail.com> * update jenkinsfile Signed-off-by: ericharper <complex451@gmail.com> * [BUGFIX] NMT Multi-node was incorrectly computing num_replicas (NVIDIA#2380) * fix property when not using model parallel Signed-off-by: ericharper <complex451@gmail.com> * fix property when not using model parallel Signed-off-by: ericharper <complex451@gmail.com> * add debug statement Signed-off-by: ericharper <complex451@gmail.com> * add debug statement Signed-off-by: ericharper <complex451@gmail.com> * instantiate with NLPDDPPlugin with num_nodes from trainer config Signed-off-by: ericharper <complex451@gmail.com> * Update ASR scripts for tokenizer building and tarred dataset building (NVIDIA#2381) * Update ASR scripts for tokenizer building and tarred dataset building Signed-off-by: smajumdar <titu1994@gmail.com> * Update container Signed-off-by: smajumdar <titu1994@gmail.com> * Add STT Zh Citrinet 1024 Gamma 0.25 model Signed-off-by: smajumdar <titu1994@gmail.com> * Update notebook (NVIDIA#2391) Signed-off-by: smajumdar <titu1994@gmail.com> * ASR Notebooks fix for 1.1.0 (NVIDIA#2395) * nb fix for spring clean Signed-off-by: fayejf <fayejf07@gmail.com> * remove outdated instruction Signed-off-by: fayejf <fayejf07@gmail.com> * Mean normalization (NVIDIA#2397) * norm embeddings Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * move to utils Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * Bugfix adaptive spec augment time masking (NVIDIA#2398) * bugfix adaptive spec augment Signed-off-by: smajumdar <titu1994@gmail.com> * Revert freq mask guard Signed-off-by: smajumdar <titu1994@gmail.com> * Revert freq mask guard Signed-off-by: smajumdar <titu1994@gmail.com> * Remove static time width clamping Signed-off-by: smajumdar <titu1994@gmail.com> * Correct typos and issues with notebooks (NVIDIA#2402) * Fix Primer notebook Signed-off-by: smajumdar <titu1994@gmail.com> * Typo Signed-off-by: smajumdar <titu1994@gmail.com> * remove accelerator=DDP in tutorial notebooks to avoid errors. (NVIDIA#2403) Signed-off-by: Hoo Chang Shin <hshin@nvidia.com> Co-authored-by: Hoo Chang Shin <hshin@nvidia.com> * style Signed-off-by: ericharper <complex451@gmail.com> * update jenkins branch Signed-off-by: ericharper <complex451@gmail.com> * update notebook branch to main Signed-off-by: ericharper <complex451@gmail.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: fayejf <36722593+fayejf@users.noreply.github.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: khcs <khcs@users.noreply.github.com> Co-authored-by: Hoo Chang Shin <hshin@nvidia.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Remove unused imports Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add initial doc for text_normalization Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Fixed imports warnings Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Minor Fix Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Renamed Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Allowed duplex modes Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Minor Fix Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add docs for duplex_text_normalization_train and duplex_text_normalization_test Signed-off-by: Tuan Lai <tuanl@nvidia.com> * docstrings for model codes + minor fix Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add more comments and doc strings Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add doc for datasets + Use time.perf_counter() Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add code for preprocessing Google TN data Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add more docs and comments + Minor Fixes Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add more licenses + Fixed comments + Minors Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Moved evaluation logic to DuplexTextNormalizationModel Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add logging errors Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Updated validation code of tagger + Minors Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Also write tag preds to log file Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add data augmentation for tagger dataset Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Added experimental decorators Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Updated docs Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Updated duplex_tn_config.yaml Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Compute token precision of tagger using NeMo metrics Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Fixed saving issue when using ddp accelerator Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Refactoring Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add option to keep punctuations in TextNormalizationTestDataset Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Changes to input preprocessing + decoder's postprocessing Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Fixed styles + Add references Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Renamed examples/nlp/duplex_text_normalization/utils.py to helpers.py Signed-off-by: Tuan Lai <tuanl@nvidia.com> Co-authored-by: Jagadeesh Balam <4916480+jbalam-nv@users.noreply.github.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: Samuel Kriman <samuelkriman@gmail.com> Co-authored-by: Oktai Tatanov <oktai.tatanov@gmail.com> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: Mike Chrzanowski <mike.chrzanowski0@gmail.com> Co-authored-by: Evelina <10428420+ekmb@users.noreply.github.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Aleksey Grinchuk (Oleksii Hrinchuk) <grinchuk.alexey@gmail.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Eric Harper <complex451@gmail.com> Co-authored-by: mchrzanowski <mchrzanowski@nvidia.com> Co-authored-by: Yang Zhang <yzhang123@users.noreply.github.com> Co-authored-by: Boris Fomitchev <borisfom@users.noreply.github.com> Co-authored-by: root <root@dgx0026.nsv.rno1.nvmetal.net> Co-authored-by: root <root@dgx0079.nsv.rno1.nvmetal.net> Co-authored-by: fayejf <36722593+fayejf@users.noreply.github.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: khcs <khcs@users.noreply.github.com> Co-authored-by: Hoo Chang Shin <hshin@nvidia.com>
paarthneekhara
pushed a commit
to paarthneekhara/NeMo
that referenced
this pull request
Sep 17, 2021
* Add notebook with recommendations for 8 kHz speech (NVIDIA#2326) * Added a notebook with best practices for telephony speech * Added datasets detaiils * Added training recommendations * Emptied out cells with results * Added tutorial to docs Signed-off-by: jbalam <jbalam@nvidia.com> * Addressed review comments Signed-off-by: jbalam <jbalam@nvidia.com> * Added a line to note original sampling rate of an4 Signed-off-by: jbalam <jbalam@nvidia.com> * Made changes suggested in review Signed-off-by: jbalam <jbalam@nvidia.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add FastEmit support for RNNT Losses (NVIDIA#2374) * Temp commit Signed-off-by: smajumdar <titu1994@gmail.com> * Initial code for fastemit forward pass Signed-off-by: smajumdar <titu1994@gmail.com> * Correct return reg value Signed-off-by: smajumdar <titu1994@gmail.com> * Initial cpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Try gpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Try gpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Correct few impl Signed-off-by: smajumdar <titu1994@gmail.com> * Update fastemit scaling Signed-off-by: smajumdar <titu1994@gmail.com> * Cleanup fastemit Signed-off-by: smajumdar <titu1994@gmail.com> * Finalize FastEmit regularization PR Signed-off-by: smajumdar <titu1994@gmail.com> * Refactor code to support fastemit regularization Signed-off-by: smajumdar <titu1994@gmail.com> Co-authored-by: Samuel Kriman <samuelkriman@gmail.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Implement inference functions of TN models Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Minor Fix Signed-off-by: Tuan Lai <tuanl@nvidia.com> * fix bugs in hifigan code (NVIDIA#2392) Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Update setup.py (NVIDIA#2394) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * update checkpointing (NVIDIA#2396) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * byt5 unicode implementation (NVIDIA#2365) * Audio Norm (NVIDIA#2285) * add jenkins test, refactoring Signed-off-by: ekmb <ebakhturina@nvidia.com> * update test Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix new test Signed-off-by: ekmb <ebakhturina@nvidia.com> * add serial to the default normalizer, add tests Signed-off-by: ekmb <ebakhturina@nvidia.com> * manifest test added Signed-off-by: ekmb <ebakhturina@nvidia.com> * expose more params, new test cases Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix jenkins, serial clean, exclude range from cardinal Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins dollar sign format Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins dollar sign format Signed-off-by: ekmb <ebakhturina@nvidia.com> * addressed review comments Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix decimal in measure Signed-off-by: ekmb <ebakhturina@nvidia.com> * move serial in cardinal Signed-off-by: ekmb <ebakhturina@nvidia.com> * clean up Signed-off-by: ekmb <ebakhturina@nvidia.com> * update for SH zero -> oh Signed-off-by: ekmb <ebakhturina@nvidia.com> * change n_tagger default Signed-off-by: ekmb <ebakhturina@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * bumping version to 1.0.1 Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Add check for numba regardless of device Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * upper bound for webdataset Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Correct Dockerfile Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update readmes Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update README (NVIDIA#2332) Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * ddp translate GPU allocation fix (NVIDIA#2312) * fixed branch in IR tutorial Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> * ddp translate GPU allocation fix Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> * map_location instead of set_device Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Shallow fusion (NVIDIA#2315) * fixed branch in IR tutorial Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> * shallow fusion init commit Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> * debug info removed Signed-off-by: AlexGrinch <grinchuk.alexey@gmail.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * [BUGFIX] Add upper bound to hydra for 1.0.x (NVIDIA#2337) * upper bound hydra Signed-off-by: ericharper <complex451@gmail.com> * upper bound hydra Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update version number Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update package version Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * sparrowhawk tests + punctuation post processing for pynini TN (NVIDIA#2320) * add jenkins test, refactoring Signed-off-by: ekmb <ebakhturina@nvidia.com> * update test Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix new test Signed-off-by: ekmb <ebakhturina@nvidia.com> * add serial to the default normalizer, add tests Signed-off-by: ekmb <ebakhturina@nvidia.com> * manifest test added Signed-off-by: ekmb <ebakhturina@nvidia.com> * expose more params, new test cases Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix jenkins, serial clean, exclude range from cardinal Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins dollar sign format Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins Signed-off-by: ekmb <ebakhturina@nvidia.com> * jenkins dollar sign format Signed-off-by: ekmb <ebakhturina@nvidia.com> * addressed review comments Signed-off-by: ekmb <ebakhturina@nvidia.com> * fix decimal in measure Signed-off-by: ekmb <ebakhturina@nvidia.com> * move serial in cardinal Signed-off-by: ekmb <ebakhturina@nvidia.com> * sh tests init Signed-off-by: ekmb <ebakhturina@nvidia.com> * sparrowhawk container tests support added Signed-off-by: ekmb <ebakhturina@nvidia.com> * add post process to normalize.py, update tests Signed-off-by: ekmb <ebakhturina@nvidia.com> * remove duplication Signed-off-by: ekmb <ebakhturina@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update notebooks to 1.0.2 release (NVIDIA#2338) Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update ranges for omegaconf and hydra (NVIDIA#2336) * Update ranges Signed-off-by: smajumdar <titu1994@gmail.com> * Updates for Hydra and OmegaConf updates Signed-off-by: smajumdar <titu1994@gmail.com> * Style fixes Signed-off-by: smajumdar <titu1994@gmail.com> * Correct tests and revert patch for model utils Signed-off-by: smajumdar <titu1994@gmail.com> * Correct docstring Signed-off-by: smajumdar <titu1994@gmail.com> * Revert unnecessary change Signed-off-by: smajumdar <titu1994@gmail.com> * Revert unnecessary change Signed-off-by: smajumdar <titu1994@gmail.com> * Guard scheduler for None Signed-off-by: smajumdar <titu1994@gmail.com> * default to 0.0 if bpe_dropout is None Signed-off-by: ericharper <complex451@gmail.com> * Correctly log class that was restored Signed-off-by: smajumdar <titu1994@gmail.com> * Root patch *bpe_dropout Signed-off-by: smajumdar <titu1994@gmail.com> Co-authored-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update FastPitch Export (NVIDIA#2355) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * byt5 unicode implementation, first cut Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * add bytelevel tokenizer Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update out_dir to not collide (NVIDIA#2358) Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update container version to 21.05 (NVIDIA#2309) * Update container version Signed-off-by: smajumdar <titu1994@gmail.com> * Temporarily change export format of waveglow Signed-off-by: smajumdar <titu1994@gmail.com> * Add conda update for numba Signed-off-by: smajumdar <titu1994@gmail.com> * Update numba compat via global flag for strictness level `--relax_numba_compat`, remove pytorchlightning.metrics, refactor out numba utils to core, update tests Signed-off-by: smajumdar <titu1994@gmail.com> * Correct order of numba minimum verion, remove wrong flag from test Signed-off-by: smajumdar <titu1994@gmail.com> * Double test of cuda numba Signed-off-by: smajumdar <titu1994@gmail.com> * Double test of cuda numba Signed-off-by: smajumdar <titu1994@gmail.com> * Enable RNNT tests Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Text Normalization Update (NVIDIA#2356) * upper cased date support Signed-off-by: ekmb <ebakhturina@nvidia.com> * update whitelist, change roman weights Signed-off-by: ekmb <ebakhturina@nvidia.com> * docstrings, space fix, init file Signed-off-by: ekmb <ebakhturina@nvidia.com> * lgtm Signed-off-by: ekmb <ebakhturina@nvidia.com> * fraction with measure class Signed-off-by: ekmb <ebakhturina@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * address comment Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Add ASR CTC tutorial on fine-tuning on another language (NVIDIA#2346) * Add ASR CTC Language finetuning notebook Signed-off-by: smajumdar <titu1994@gmail.com> * Add to documentation Signed-off-by: smajumdar <titu1994@gmail.com> * Improve documentation Signed-off-by: smajumdar <titu1994@gmail.com> * Correct name of the dataset Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Correct colab link to notebook (NVIDIA#2366) Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * sgdqa update data directories for testing (NVIDIA#2323) * sgdqa update data directories for testing Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * fix syntax Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * check if data dir exists Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * fix Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * adding pretrained model Signed-off-by: Yang Zhang <yangzhang@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Added documentation for export() (NVIDIA#2330) * Added export document Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com> * Addressed review comments Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com> Co-authored-by: Eric Harper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update Citrinet model card info (NVIDIA#2369) * Update model card info Signed-off-by: smajumdar <titu1994@gmail.com> * Cleanup Docs Signed-off-by: smajumdar <titu1994@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * [NMT] Model Parallel Megatron Encoders (NVIDIA#2238) * add megatron encoder Signed-off-by: ericharper <complex451@gmail.com> * added megatron to get_nmt_tokenizer Signed-off-by: ericharper <complex451@gmail.com> * add vocab_size and hidden_size to megatron bert Signed-off-by: ericharper <complex451@gmail.com> * add megatron encoder module Signed-off-by: ericharper <complex451@gmail.com> * fixed horrible typo Signed-off-by: ericharper <complex451@gmail.com> * fix typo and add default Signed-off-by: ericharper <complex451@gmail.com> * updating nlp overrides for mp nmt Signed-off-by: ericharper <complex451@gmail.com> * move some logic back to nlpmodel from overrides Signed-off-by: ericharper <complex451@gmail.com> * add checkpoint_file property Signed-off-by: ericharper <complex451@gmail.com> * fix property Signed-off-by: ericharper <complex451@gmail.com> * num_tokentypes=0 Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * find_unused_parameters=True Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * style Signed-off-by: ericharper <complex451@gmail.com> * get instead of pop Signed-off-by: ericharper <complex451@gmail.com> * remove token type ids from megatron input example Signed-off-by: ericharper <complex451@gmail.com> * pop vocab_size Signed-off-by: ericharper <complex451@gmail.com> * fix checkpointing for model parallel Signed-off-by: ericharper <complex451@gmail.com> * fix bug in non model parallel Signed-off-by: ericharper <complex451@gmail.com> * convert cfg.trainer to dict Signed-off-by: ericharper <complex451@gmail.com> * make num_tokentypes configurable for nmt Signed-off-by: ericharper <complex451@gmail.com> * update checkpoint_file when using named megatron model in nemo Signed-off-by: ericharper <complex451@gmail.com> * make vocab_file configurable Signed-off-by: ericharper <complex451@gmail.com> * dataclass can't have mutable default Signed-off-by: ericharper <complex451@gmail.com> * style Signed-off-by: ericharper <complex451@gmail.com> * unused imports Signed-off-by: ericharper <complex451@gmail.com> * revert input example Signed-off-by: ericharper <complex451@gmail.com> * check that checkpoint version is not None Signed-off-by: ericharper <complex451@gmail.com> * add mp jenkins test Signed-off-by: ericharper <complex451@gmail.com> * update docstring Signed-off-by: ericharper <complex451@gmail.com> * add docs for pretrained encoders with nemo nmt Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Add notebook with recommendations for 8 kHz speech (NVIDIA#2326) * Added a notebook with best practices for telephony speech * Added datasets detaiils * Added training recommendations * Emptied out cells with results * Added tutorial to docs Signed-off-by: jbalam <jbalam@nvidia.com> * Addressed review comments Signed-off-by: jbalam <jbalam@nvidia.com> * Added a line to note original sampling rate of an4 Signed-off-by: jbalam <jbalam@nvidia.com> * Made changes suggested in review Signed-off-by: jbalam <jbalam@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Add FastEmit support for RNNT Losses (NVIDIA#2374) * Temp commit Signed-off-by: smajumdar <titu1994@gmail.com> * Initial code for fastemit forward pass Signed-off-by: smajumdar <titu1994@gmail.com> * Correct return reg value Signed-off-by: smajumdar <titu1994@gmail.com> * Initial cpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Try gpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Try gpu impl Signed-off-by: smajumdar <titu1994@gmail.com> * Correct few impl Signed-off-by: smajumdar <titu1994@gmail.com> * Update fastemit scaling Signed-off-by: smajumdar <titu1994@gmail.com> * Cleanup fastemit Signed-off-by: smajumdar <titu1994@gmail.com> * Finalize FastEmit regularization PR Signed-off-by: smajumdar <titu1994@gmail.com> * Refactor code to support fastemit regularization Signed-off-by: smajumdar <titu1994@gmail.com> Co-authored-by: Samuel Kriman <samuelkriman@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * byt5 unicode implementation, first cut Signed-off-by: Mike Chrzanowski <mchrzanowski@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * add bytelevel tokenizer Signed-off-by: Mike Chrzanowski <mchrzanowski@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update styling Signed-off-by: Mike Chrzanowski <mchrzanowski@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * avoid circular import Signed-off-by: Mike Chrzanowski <mchrzanowski@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * fix bugs in hifigan code (NVIDIA#2392) Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update setup.py (NVIDIA#2394) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update bytelevel_tokenizer.py Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * Update bytelevel_tokenizer.py Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * typo Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * missed one Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * bug fixes Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * style fix Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * bytelevelprocessor is now generic. Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * style fix Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * update checkpointing (NVIDIA#2396) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * style Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * woops, didnt merge jenkinsfile the right way * add newline Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * undo changes to enja processor Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * processor selection decision fix Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> * newline fix Signed-off-by: mchrzanowski <mchrzanowski@nvidia.com> Co-authored-by: Evelina <10428420+ekmb@users.noreply.github.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Aleksey Grinchuk (Oleksii Hrinchuk) <grinchuk.alexey@gmail.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Eric Harper <complex451@gmail.com> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: mchrzanowski <mchrzanowski@nvidia.com> Co-authored-by: Yang Zhang <yzhang123@users.noreply.github.com> Co-authored-by: Boris Fomitchev <borisfom@users.noreply.github.com> Co-authored-by: Jagadeesh Balam <4916480+jbalam-nv@users.noreply.github.com> Co-authored-by: Samuel Kriman <samuelkriman@gmail.com> Co-authored-by: Oktai Tatanov <oktai.tatanov@gmail.com> Co-authored-by: root <root@dgx0026.nsv.rno1.nvmetal.net> Co-authored-by: root <root@dgx0079.nsv.rno1.nvmetal.net> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Minor Fix Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Minor Fixes Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add TextNormalizationTestDataset and testing/evaluation code Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add TextNormalizationTaggerDataset and training code for tagger Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Restore from local nemo ckpts Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add TextNormalizationDecoderDataset Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add interactive mode for neural_text_normalization_test.py Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add options to do training or not for tagger/decoder Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Renamed Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Implemented setup dataloader for decoder Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Implemented training and validation for decoder Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Data augmentation for decoder training Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Config change Signed-off-by: Tuan Lai <tuanl@nvidia.com> * add blossom-ci.yml (NVIDIA#2401) Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Merge r1.1 bugfixes into main (NVIDIA#2407) * Update notebook branch and Jenkinsfile for 1.1.0 testing (NVIDIA#2378) * update branch Signed-off-by: ericharper <complex451@gmail.com> * update jenkinsfile Signed-off-by: ericharper <complex451@gmail.com> * [BUGFIX] NMT Multi-node was incorrectly computing num_replicas (NVIDIA#2380) * fix property when not using model parallel Signed-off-by: ericharper <complex451@gmail.com> * fix property when not using model parallel Signed-off-by: ericharper <complex451@gmail.com> * add debug statement Signed-off-by: ericharper <complex451@gmail.com> * add debug statement Signed-off-by: ericharper <complex451@gmail.com> * instantiate with NLPDDPPlugin with num_nodes from trainer config Signed-off-by: ericharper <complex451@gmail.com> * Update ASR scripts for tokenizer building and tarred dataset building (NVIDIA#2381) * Update ASR scripts for tokenizer building and tarred dataset building Signed-off-by: smajumdar <titu1994@gmail.com> * Update container Signed-off-by: smajumdar <titu1994@gmail.com> * Add STT Zh Citrinet 1024 Gamma 0.25 model Signed-off-by: smajumdar <titu1994@gmail.com> * Update notebook (NVIDIA#2391) Signed-off-by: smajumdar <titu1994@gmail.com> * ASR Notebooks fix for 1.1.0 (NVIDIA#2395) * nb fix for spring clean Signed-off-by: fayejf <fayejf07@gmail.com> * remove outdated instruction Signed-off-by: fayejf <fayejf07@gmail.com> * Mean normalization (NVIDIA#2397) * norm embeddings Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * move to utils Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * Bugfix adaptive spec augment time masking (NVIDIA#2398) * bugfix adaptive spec augment Signed-off-by: smajumdar <titu1994@gmail.com> * Revert freq mask guard Signed-off-by: smajumdar <titu1994@gmail.com> * Revert freq mask guard Signed-off-by: smajumdar <titu1994@gmail.com> * Remove static time width clamping Signed-off-by: smajumdar <titu1994@gmail.com> * Correct typos and issues with notebooks (NVIDIA#2402) * Fix Primer notebook Signed-off-by: smajumdar <titu1994@gmail.com> * Typo Signed-off-by: smajumdar <titu1994@gmail.com> * remove accelerator=DDP in tutorial notebooks to avoid errors. (NVIDIA#2403) Signed-off-by: Hoo Chang Shin <hshin@nvidia.com> Co-authored-by: Hoo Chang Shin <hshin@nvidia.com> * style Signed-off-by: ericharper <complex451@gmail.com> * update jenkins branch Signed-off-by: ericharper <complex451@gmail.com> * update notebook branch to main Signed-off-by: ericharper <complex451@gmail.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: fayejf <36722593+fayejf@users.noreply.github.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: khcs <khcs@users.noreply.github.com> Co-authored-by: Hoo Chang Shin <hshin@nvidia.com> Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Remove unused imports Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add initial doc for text_normalization Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Fixed imports warnings Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Minor Fix Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Renamed Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Allowed duplex modes Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Minor Fix Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add docs for duplex_text_normalization_train and duplex_text_normalization_test Signed-off-by: Tuan Lai <tuanl@nvidia.com> * docstrings for model codes + minor fix Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add more comments and doc strings Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add doc for datasets + Use time.perf_counter() Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add code for preprocessing Google TN data Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add more docs and comments + Minor Fixes Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add more licenses + Fixed comments + Minors Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Moved evaluation logic to DuplexTextNormalizationModel Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add logging errors Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Updated validation code of tagger + Minors Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Also write tag preds to log file Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add data augmentation for tagger dataset Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Added experimental decorators Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Updated docs Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Updated duplex_tn_config.yaml Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Compute token precision of tagger using NeMo metrics Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Fixed saving issue when using ddp accelerator Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Refactoring Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Add option to keep punctuations in TextNormalizationTestDataset Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Changes to input preprocessing + decoder's postprocessing Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Fixed styles + Add references Signed-off-by: Tuan Lai <tuanl@nvidia.com> * Renamed examples/nlp/duplex_text_normalization/utils.py to helpers.py Signed-off-by: Tuan Lai <tuanl@nvidia.com> Co-authored-by: Jagadeesh Balam <4916480+jbalam-nv@users.noreply.github.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: Samuel Kriman <samuelkriman@gmail.com> Co-authored-by: Oktai Tatanov <oktai.tatanov@gmail.com> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: Mike Chrzanowski <mike.chrzanowski0@gmail.com> Co-authored-by: Evelina <10428420+ekmb@users.noreply.github.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Aleksey Grinchuk (Oleksii Hrinchuk) <grinchuk.alexey@gmail.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Eric Harper <complex451@gmail.com> Co-authored-by: mchrzanowski <mchrzanowski@nvidia.com> Co-authored-by: Yang Zhang <yzhang123@users.noreply.github.com> Co-authored-by: Boris Fomitchev <borisfom@users.noreply.github.com> Co-authored-by: root <root@dgx0026.nsv.rno1.nvmetal.net> Co-authored-by: root <root@dgx0079.nsv.rno1.nvmetal.net> Co-authored-by: fayejf <36722593+fayejf@users.noreply.github.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: khcs <khcs@users.noreply.github.com> Co-authored-by: Hoo Chang Shin <hshin@nvidia.com> Signed-off-by: Paarth Neekhara <paarth.n@gmail.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Added code for training/evaluating a text normalization system which consists of:
(1) A tagger - for identifying semiotic classes in the input
(2) A decoder - for decoding the spans of semiotic classes into spoken form.
@yzhang123 @ekmb