Megatron encode function with RPE fix #4692
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca>
MaximumEntropy
changed the title
Davood-M
pushed a commit
to Davood-M/NeMo
that referenced
this pull request
Aug 9, 2022
* Fix for RPE Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Signed-off-by: David Mosallanezhad <dmosallanezh@nvidia.com>
ericharper
pushed a commit
that referenced
this pull request
Aug 22, 2022
* Fix for RPE Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca>
ericharper
added a commit
that referenced
this pull request
Aug 24, 2022
* NeMo Megatron doc updates Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * update branch Signed-off-by: ericharper <complex451@gmail.com> * update package info and dockerfile Signed-off-by: ericharper <complex451@gmail.com> * fix fastpitch export (#4676) Signed-off-by: Jason <jasoli@nvidia.com> * [TTS] fixed wrong pronunciations for r1.11. (#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Fix for incorrect batch size issue while decoding (#4675) Co-authored-by: Micha Livne <michalivne@users.noreply.github.com> Co-authored-by: Eric Harper <complex451@gmail.com> * [TTS] incremented the version number to 22.08 in tutorials. (#4684) * [TTS] incremented the version number to 22.08 in tutorials. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Megatron encode function with RPE fix (#4692) * Fix for RPE Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * fix to fetch config file (#4699) Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * Fix notebook for buffered inference (#4703) Signed-off-by: smajumdar <smajumdar@nvidia.com> * Prompt Learning Notebook Bug Fix (#4689) * Added back dataset class list of dict input for generation in tutorial notebook Signed-off-by: Virginia Adams <vadams@nvidia.com> * updated argument name for build dataset Signed-off-by: Virginia Adams <vadams@nvidia.com> Signed-off-by: Virginia Adams <vadams@nvidia.com> * add psutils to mock imports (#4728) Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: ericharper <complex451@gmail.com> * Update Aligner model and tutorial to add NGC checkpoint loading (#4714) * Update Aligner model and tutorial to add NGC checkpoint loading Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> * Fix pynini install for Aligner notebook, minor formatting fix for model Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> * Aligner notebook formatting consistency Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * [TTS] bugfix for missing configs. (#4725) Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * docs typo fix Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * Fix pynini install in TTS tutorials (#4729) Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> * Fix ASR notebooks (#4738) Signed-off-by: smajumdar <smajumdar@nvidia.com> Signed-off-by: smajumdar <smajumdar@nvidia.com> * Multilingual VAD model (#4734) * add ngc link Signed-off-by: fayejf <fayejf07@gmail.com> * add tuned VAD config on ASR data Signed-off-by: fayejf <fayejf07@gmail.com> * yaml note Signed-off-by: fayejf <fayejf07@gmail.com> * update vad asr notebook with mVAD Signed-off-by: fayejf <fayejf07@gmail.com> * update vad infer config comment Signed-off-by: fayejf <fayejf07@gmail.com> * fix Signed-off-by: fayejf <fayejf07@gmail.com> * mvad sd config for ch109 Signed-off-by: fayejf <fayejf07@gmail.com> * update sd readme Signed-off-by: fayejf <fayejf07@gmail.com> * add new mVAD model to doc Signed-off-by: fayejf <fayejf07@gmail.com> * style fix Signed-off-by: fayejf <fayejf07@gmail.com> * update sd tutorial with mVAD Signed-off-by: fayejf <fayejf07@gmail.com> * typo fix Signed-off-by: fayejf <fayejf07@gmail.com> Signed-off-by: fayejf <fayejf07@gmail.com> * publish pretrained itn t5 model for English (#4748) Signed-off-by: Alexandra Antonova <aleksandraa@nvidia.com> Signed-off-by: Alexandra Antonova <aleksandraa@nvidia.com> Co-authored-by: Alexandra Antonova <aleksandraa@nvidia.com> * Updated docs and doc paths (#4754) * Updated docs and doc paths Signed-off-by: Virginia Adams <vadams@nvidia.com> * Update Multitask_Prompt_and_PTuning.ipynb * Update README.rst * Changed branch name to use single quotes Signed-off-by: Virginia Adams <vadams@nvidia.com> Signed-off-by: Virginia Adams <vadams@nvidia.com> * fix bug relating to ddp strategy in joint intent slot classification tutorial (#4762) * [TTS] updated config with a German IPA phoneme tokenizer (#4756) * [TTS] added a German IPA phoneme tokenizer * [TTS][ASR] enabled customized arguments for trimming the leading and trailing silence. * [TTS] disabled spline interpolation for beta-binomial distribution. Let it generate align prior and save to disks. Use a new phoneme tokenizer. * [TTS] use consistent spline interpolation with fastpitch checkpoint when generating mel-spectrograms for hifigan finetune. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Update r1.11 to new heteronyms list (#4745) * Update configs to new heteronyms list * Remove old heteronyms list, add alt 'merchandise' pron to CMUdict * Update remaining references to old heteronyms list Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * [TTS] Add multi-speaker German FastPitch and HiFiGAN NGC checkpoints (#4763) Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * [TTS] Add single male speaker German FastPitch and HiFiGAN NGC checkpoints (#4770) Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Update CMUdict with more recent 0.7b entries (#4768) Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Install pynini in docker container (#4733) Signed-off-by: Vladimir Bataev <vbataev@nvidia.com> Signed-off-by: Vladimir Bataev <vbataev@nvidia.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Co-authored-by: Eric Harper <complex451@gmail.com> * Fix tutorial formatting (#4778) Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> * [TTS] deprecated old scripts for ljspeech. (#4780) * deprecated old scripts for ljspeech. * removed relevent function calls in TTS docs. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * update branch Signed-off-by: ericharper <complex451@gmail.com> * update package info and requirements Signed-off-by: ericharper <complex451@gmail.com> * update container Signed-off-by: ericharper <complex451@gmail.com> * Update stragglers to new cmudict and heteronyms paths Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> Signed-off-by: smajumdar <smajumdar@nvidia.com> Signed-off-by: Virginia Adams <vadams@nvidia.com> Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: fayejf <fayejf07@gmail.com> Signed-off-by: Alexandra Antonova <aleksandraa@nvidia.com> Signed-off-by: Vladimir Bataev <vbataev@nvidia.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Co-authored-by: Rajesh Ilango <rilango@gmail.com> Co-authored-by: Micha Livne <michalivne@users.noreply.github.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: Virginia Adams <78445382+vadam5@users.noreply.github.com> Co-authored-by: Jocelyn <jocelynh@nvidia.com> Co-authored-by: fayejf <36722593+fayejf@users.noreply.github.com> Co-authored-by: bene-ges <61418381+bene-ges@users.noreply.github.com> Co-authored-by: Alexandra Antonova <aleksandraa@nvidia.com> Co-authored-by: Zhilin Wang <wangzhilin12061996@hotmail.com> Co-authored-by: Vladimir Bataev <vbataev@nvidia.com>
piraka9011
pushed a commit
to piraka9011/NeMo
that referenced
this pull request
Aug 25, 2022
* NeMo Megatron doc updates Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * update branch Signed-off-by: ericharper <complex451@gmail.com> * update package info and dockerfile Signed-off-by: ericharper <complex451@gmail.com> * fix fastpitch export (NVIDIA#4676) Signed-off-by: Jason <jasoli@nvidia.com> * [TTS] fixed wrong pronunciations for r1.11. (NVIDIA#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Fix for incorrect batch size issue while decoding (NVIDIA#4675) Co-authored-by: Micha Livne <michalivne@users.noreply.github.com> Co-authored-by: Eric Harper <complex451@gmail.com> * [TTS] incremented the version number to 22.08 in tutorials. (NVIDIA#4684) * [TTS] incremented the version number to 22.08 in tutorials. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Megatron encode function with RPE fix (NVIDIA#4692) * Fix for RPE Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * fix to fetch config file (NVIDIA#4699) Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * Fix notebook for buffered inference (NVIDIA#4703) Signed-off-by: smajumdar <smajumdar@nvidia.com> * Prompt Learning Notebook Bug Fix (NVIDIA#4689) * Added back dataset class list of dict input for generation in tutorial notebook Signed-off-by: Virginia Adams <vadams@nvidia.com> * updated argument name for build dataset Signed-off-by: Virginia Adams <vadams@nvidia.com> Signed-off-by: Virginia Adams <vadams@nvidia.com> * add psutils to mock imports (NVIDIA#4728) Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: ericharper <complex451@gmail.com> * Update Aligner model and tutorial to add NGC checkpoint loading (NVIDIA#4714) * Update Aligner model and tutorial to add NGC checkpoint loading Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> * Fix pynini install for Aligner notebook, minor formatting fix for model Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> * Aligner notebook formatting consistency Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * [TTS] bugfix for missing configs. (NVIDIA#4725) Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * docs typo fix Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * Fix pynini install in TTS tutorials (NVIDIA#4729) Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> * Fix ASR notebooks (NVIDIA#4738) Signed-off-by: smajumdar <smajumdar@nvidia.com> Signed-off-by: smajumdar <smajumdar@nvidia.com> * Multilingual VAD model (NVIDIA#4734) * add ngc link Signed-off-by: fayejf <fayejf07@gmail.com> * add tuned VAD config on ASR data Signed-off-by: fayejf <fayejf07@gmail.com> * yaml note Signed-off-by: fayejf <fayejf07@gmail.com> * update vad asr notebook with mVAD Signed-off-by: fayejf <fayejf07@gmail.com> * update vad infer config comment Signed-off-by: fayejf <fayejf07@gmail.com> * fix Signed-off-by: fayejf <fayejf07@gmail.com> * mvad sd config for ch109 Signed-off-by: fayejf <fayejf07@gmail.com> * update sd readme Signed-off-by: fayejf <fayejf07@gmail.com> * add new mVAD model to doc Signed-off-by: fayejf <fayejf07@gmail.com> * style fix Signed-off-by: fayejf <fayejf07@gmail.com> * update sd tutorial with mVAD Signed-off-by: fayejf <fayejf07@gmail.com> * typo fix Signed-off-by: fayejf <fayejf07@gmail.com> Signed-off-by: fayejf <fayejf07@gmail.com> * publish pretrained itn t5 model for English (NVIDIA#4748) Signed-off-by: Alexandra Antonova <aleksandraa@nvidia.com> Signed-off-by: Alexandra Antonova <aleksandraa@nvidia.com> Co-authored-by: Alexandra Antonova <aleksandraa@nvidia.com> * Updated docs and doc paths (NVIDIA#4754) * Updated docs and doc paths Signed-off-by: Virginia Adams <vadams@nvidia.com> * Update Multitask_Prompt_and_PTuning.ipynb * Update README.rst * Changed branch name to use single quotes Signed-off-by: Virginia Adams <vadams@nvidia.com> Signed-off-by: Virginia Adams <vadams@nvidia.com> * fix bug relating to ddp strategy in joint intent slot classification tutorial (NVIDIA#4762) * [TTS] updated config with a German IPA phoneme tokenizer (NVIDIA#4756) * [TTS] added a German IPA phoneme tokenizer * [TTS][ASR] enabled customized arguments for trimming the leading and trailing silence. * [TTS] disabled spline interpolation for beta-binomial distribution. Let it generate align prior and save to disks. Use a new phoneme tokenizer. * [TTS] use consistent spline interpolation with fastpitch checkpoint when generating mel-spectrograms for hifigan finetune. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Update r1.11 to new heteronyms list (NVIDIA#4745) * Update configs to new heteronyms list * Remove old heteronyms list, add alt 'merchandise' pron to CMUdict * Update remaining references to old heteronyms list Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * [TTS] Add multi-speaker German FastPitch and HiFiGAN NGC checkpoints (NVIDIA#4763) Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * [TTS] Add single male speaker German FastPitch and HiFiGAN NGC checkpoints (NVIDIA#4770) Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Update CMUdict with more recent 0.7b entries (NVIDIA#4768) Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Install pynini in docker container (NVIDIA#4733) Signed-off-by: Vladimir Bataev <vbataev@nvidia.com> Signed-off-by: Vladimir Bataev <vbataev@nvidia.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Co-authored-by: Eric Harper <complex451@gmail.com> * Fix tutorial formatting (NVIDIA#4778) Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> * [TTS] deprecated old scripts for ljspeech. (NVIDIA#4780) * deprecated old scripts for ljspeech. * removed relevent function calls in TTS docs. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * update branch Signed-off-by: ericharper <complex451@gmail.com> * update package info and requirements Signed-off-by: ericharper <complex451@gmail.com> * update container Signed-off-by: ericharper <complex451@gmail.com> * Update stragglers to new cmudict and heteronyms paths Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> Signed-off-by: smajumdar <smajumdar@nvidia.com> Signed-off-by: Virginia Adams <vadams@nvidia.com> Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: fayejf <fayejf07@gmail.com> Signed-off-by: Alexandra Antonova <aleksandraa@nvidia.com> Signed-off-by: Vladimir Bataev <vbataev@nvidia.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Co-authored-by: Rajesh Ilango <rilango@gmail.com> Co-authored-by: Micha Livne <michalivne@users.noreply.github.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: Virginia Adams <78445382+vadam5@users.noreply.github.com> Co-authored-by: Jocelyn <jocelynh@nvidia.com> Co-authored-by: fayejf <36722593+fayejf@users.noreply.github.com> Co-authored-by: bene-ges <61418381+bene-ges@users.noreply.github.com> Co-authored-by: Alexandra Antonova <aleksandraa@nvidia.com> Co-authored-by: Zhilin Wang <wangzhilin12061996@hotmail.com> Co-authored-by: Vladimir Bataev <vbataev@nvidia.com> Signed-off-by: Anas Abou Allaban <aabouallaban@pm.me>
khcs
added a commit
that referenced
this pull request
Aug 26, 2022
* Enc-Dec RPE PP > 2 Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Syle Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * update branch Signed-off-by: ericharper <complex451@gmail.com> * update package info and dockerfile Signed-off-by: ericharper <complex451@gmail.com> * fix fastpitch export (#4676) Signed-off-by: Jason <jasoli@nvidia.com> * [TTS] fixed wrong pronunciations for r1.11. (#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Fix for incorrect batch size issue while decoding (#4675) Co-authored-by: Micha Livne <michalivne@users.noreply.github.com> Co-authored-by: Eric Harper <complex451@gmail.com> * [TTS] incremented the version number to 22.08 in tutorials. (#4684) * [TTS] incremented the version number to 22.08 in tutorials. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Megatron encode function with RPE fix (#4692) * Fix for RPE Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * fix to fetch config file (#4699) Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix rpe check Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Revert to main Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Revert more files Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Additional changes to make PP>2 with RPE work. * Fixes for O2 Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fixes Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Update Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix cross attention sync check Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix zero init Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Modify .data instead of the weight Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Add worker changes Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Set workers to 0 for validation and test Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Remove unused imports and allreduce func Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Revert workers change Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> Co-authored-by: ericharper <complex451@gmail.com> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Co-authored-by: Rajesh Ilango <rilango@gmail.com> Co-authored-by: Micha Livne <michalivne@users.noreply.github.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: Hoo Chang Shin <hshin@nvidia.com> Co-authored-by: khcs <khcs@users.noreply.github.com>
yaoyu-33
pushed a commit
that referenced
this pull request
Aug 26, 2022
* Enc-Dec RPE PP > 2 Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Syle Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * update branch Signed-off-by: ericharper <complex451@gmail.com> * update package info and dockerfile Signed-off-by: ericharper <complex451@gmail.com> * fix fastpitch export (#4676) Signed-off-by: Jason <jasoli@nvidia.com> * [TTS] fixed wrong pronunciations for r1.11. (#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Fix for incorrect batch size issue while decoding (#4675) Co-authored-by: Micha Livne <michalivne@users.noreply.github.com> Co-authored-by: Eric Harper <complex451@gmail.com> * [TTS] incremented the version number to 22.08 in tutorials. (#4684) * [TTS] incremented the version number to 22.08 in tutorials. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Megatron encode function with RPE fix (#4692) * Fix for RPE Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * fix to fetch config file (#4699) Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix rpe check Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Revert to main Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Revert more files Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Additional changes to make PP>2 with RPE work. * Fixes for O2 Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fixes Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Update Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix cross attention sync check Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix zero init Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Modify .data instead of the weight Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Add worker changes Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Set workers to 0 for validation and test Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Remove unused imports and allreduce func Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Revert workers change Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> Co-authored-by: ericharper <complex451@gmail.com> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Co-authored-by: Rajesh Ilango <rilango@gmail.com> Co-authored-by: Micha Livne <michalivne@users.noreply.github.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: Hoo Chang Shin <hshin@nvidia.com> Co-authored-by: khcs <khcs@users.noreply.github.com>
jubick1337
pushed a commit
to jubick1337/NeMo
that referenced
this pull request
Oct 3, 2022
* NeMo Megatron doc updates Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * update branch Signed-off-by: ericharper <complex451@gmail.com> * update package info and dockerfile Signed-off-by: ericharper <complex451@gmail.com> * fix fastpitch export (NVIDIA#4676) Signed-off-by: Jason <jasoli@nvidia.com> * [TTS] fixed wrong pronunciations for r1.11. (NVIDIA#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Fix for incorrect batch size issue while decoding (NVIDIA#4675) Co-authored-by: Micha Livne <michalivne@users.noreply.github.com> Co-authored-by: Eric Harper <complex451@gmail.com> * [TTS] incremented the version number to 22.08 in tutorials. (NVIDIA#4684) * [TTS] incremented the version number to 22.08 in tutorials. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Megatron encode function with RPE fix (NVIDIA#4692) * Fix for RPE Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * fix to fetch config file (NVIDIA#4699) Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * Fix notebook for buffered inference (NVIDIA#4703) Signed-off-by: smajumdar <smajumdar@nvidia.com> * Prompt Learning Notebook Bug Fix (NVIDIA#4689) * Added back dataset class list of dict input for generation in tutorial notebook Signed-off-by: Virginia Adams <vadams@nvidia.com> * updated argument name for build dataset Signed-off-by: Virginia Adams <vadams@nvidia.com> Signed-off-by: Virginia Adams <vadams@nvidia.com> * add psutils to mock imports (NVIDIA#4728) Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: ericharper <complex451@gmail.com> * Update Aligner model and tutorial to add NGC checkpoint loading (NVIDIA#4714) * Update Aligner model and tutorial to add NGC checkpoint loading Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> * Fix pynini install for Aligner notebook, minor formatting fix for model Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> * Aligner notebook formatting consistency Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * [TTS] bugfix for missing configs. (NVIDIA#4725) Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * docs typo fix Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * Fix pynini install in TTS tutorials (NVIDIA#4729) Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> * Fix ASR notebooks (NVIDIA#4738) Signed-off-by: smajumdar <smajumdar@nvidia.com> Signed-off-by: smajumdar <smajumdar@nvidia.com> * Multilingual VAD model (NVIDIA#4734) * add ngc link Signed-off-by: fayejf <fayejf07@gmail.com> * add tuned VAD config on ASR data Signed-off-by: fayejf <fayejf07@gmail.com> * yaml note Signed-off-by: fayejf <fayejf07@gmail.com> * update vad asr notebook with mVAD Signed-off-by: fayejf <fayejf07@gmail.com> * update vad infer config comment Signed-off-by: fayejf <fayejf07@gmail.com> * fix Signed-off-by: fayejf <fayejf07@gmail.com> * mvad sd config for ch109 Signed-off-by: fayejf <fayejf07@gmail.com> * update sd readme Signed-off-by: fayejf <fayejf07@gmail.com> * add new mVAD model to doc Signed-off-by: fayejf <fayejf07@gmail.com> * style fix Signed-off-by: fayejf <fayejf07@gmail.com> * update sd tutorial with mVAD Signed-off-by: fayejf <fayejf07@gmail.com> * typo fix Signed-off-by: fayejf <fayejf07@gmail.com> Signed-off-by: fayejf <fayejf07@gmail.com> * publish pretrained itn t5 model for English (NVIDIA#4748) Signed-off-by: Alexandra Antonova <aleksandraa@nvidia.com> Signed-off-by: Alexandra Antonova <aleksandraa@nvidia.com> Co-authored-by: Alexandra Antonova <aleksandraa@nvidia.com> * Updated docs and doc paths (NVIDIA#4754) * Updated docs and doc paths Signed-off-by: Virginia Adams <vadams@nvidia.com> * Update Multitask_Prompt_and_PTuning.ipynb * Update README.rst * Changed branch name to use single quotes Signed-off-by: Virginia Adams <vadams@nvidia.com> Signed-off-by: Virginia Adams <vadams@nvidia.com> * fix bug relating to ddp strategy in joint intent slot classification tutorial (NVIDIA#4762) * [TTS] updated config with a German IPA phoneme tokenizer (NVIDIA#4756) * [TTS] added a German IPA phoneme tokenizer * [TTS][ASR] enabled customized arguments for trimming the leading and trailing silence. * [TTS] disabled spline interpolation for beta-binomial distribution. Let it generate align prior and save to disks. Use a new phoneme tokenizer. * [TTS] use consistent spline interpolation with fastpitch checkpoint when generating mel-spectrograms for hifigan finetune. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Update r1.11 to new heteronyms list (NVIDIA#4745) * Update configs to new heteronyms list * Remove old heteronyms list, add alt 'merchandise' pron to CMUdict * Update remaining references to old heteronyms list Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * [TTS] Add multi-speaker German FastPitch and HiFiGAN NGC checkpoints (NVIDIA#4763) Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * [TTS] Add single male speaker German FastPitch and HiFiGAN NGC checkpoints (NVIDIA#4770) Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Update CMUdict with more recent 0.7b entries (NVIDIA#4768) Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Install pynini in docker container (NVIDIA#4733) Signed-off-by: Vladimir Bataev <vbataev@nvidia.com> Signed-off-by: Vladimir Bataev <vbataev@nvidia.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Co-authored-by: Eric Harper <complex451@gmail.com> * Fix tutorial formatting (NVIDIA#4778) Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> * [TTS] deprecated old scripts for ljspeech. (NVIDIA#4780) * deprecated old scripts for ljspeech. * removed relevent function calls in TTS docs. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * update branch Signed-off-by: ericharper <complex451@gmail.com> * update package info and requirements Signed-off-by: ericharper <complex451@gmail.com> * update container Signed-off-by: ericharper <complex451@gmail.com> * Update stragglers to new cmudict and heteronyms paths Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> Signed-off-by: smajumdar <smajumdar@nvidia.com> Signed-off-by: Virginia Adams <vadams@nvidia.com> Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: fayejf <fayejf07@gmail.com> Signed-off-by: Alexandra Antonova <aleksandraa@nvidia.com> Signed-off-by: Vladimir Bataev <vbataev@nvidia.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Co-authored-by: Rajesh Ilango <rilango@gmail.com> Co-authored-by: Micha Livne <michalivne@users.noreply.github.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: Virginia Adams <78445382+vadam5@users.noreply.github.com> Co-authored-by: Jocelyn <jocelynh@nvidia.com> Co-authored-by: fayejf <36722593+fayejf@users.noreply.github.com> Co-authored-by: bene-ges <61418381+bene-ges@users.noreply.github.com> Co-authored-by: Alexandra Antonova <aleksandraa@nvidia.com> Co-authored-by: Zhilin Wang <wangzhilin12061996@hotmail.com> Co-authored-by: Vladimir Bataev <vbataev@nvidia.com> Signed-off-by: Matvei Novikov <mattyson.so@gmail.com>
jubick1337
pushed a commit
to jubick1337/NeMo
that referenced
this pull request
Oct 3, 2022
* Enc-Dec RPE PP > 2 Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Syle Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * update branch Signed-off-by: ericharper <complex451@gmail.com> * update package info and dockerfile Signed-off-by: ericharper <complex451@gmail.com> * fix fastpitch export (NVIDIA#4676) Signed-off-by: Jason <jasoli@nvidia.com> * [TTS] fixed wrong pronunciations for r1.11. (NVIDIA#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Fix for incorrect batch size issue while decoding (NVIDIA#4675) Co-authored-by: Micha Livne <michalivne@users.noreply.github.com> Co-authored-by: Eric Harper <complex451@gmail.com> * [TTS] incremented the version number to 22.08 in tutorials. (NVIDIA#4684) * [TTS] incremented the version number to 22.08 in tutorials. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Megatron encode function with RPE fix (NVIDIA#4692) * Fix for RPE Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * fix to fetch config file (NVIDIA#4699) Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix rpe check Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Revert to main Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Revert more files Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Additional changes to make PP>2 with RPE work. * Fixes for O2 Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fixes Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Update Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix cross attention sync check Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix zero init Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Modify .data instead of the weight Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Add worker changes Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Set workers to 0 for validation and test Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Remove unused imports and allreduce func Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Revert workers change Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> Co-authored-by: ericharper <complex451@gmail.com> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Co-authored-by: Rajesh Ilango <rilango@gmail.com> Co-authored-by: Micha Livne <michalivne@users.noreply.github.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: Hoo Chang Shin <hshin@nvidia.com> Co-authored-by: khcs <khcs@users.noreply.github.com> Signed-off-by: Matvei Novikov <mattyson.so@gmail.com>
hainan-xv
pushed a commit
to hainan-xv/NeMo
that referenced
this pull request
Nov 29, 2022
* NeMo Megatron doc updates Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * update branch Signed-off-by: ericharper <complex451@gmail.com> * update package info and dockerfile Signed-off-by: ericharper <complex451@gmail.com> * fix fastpitch export (NVIDIA#4676) Signed-off-by: Jason <jasoli@nvidia.com> * [TTS] fixed wrong pronunciations for r1.11. (NVIDIA#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Fix for incorrect batch size issue while decoding (NVIDIA#4675) Co-authored-by: Micha Livne <michalivne@users.noreply.github.com> Co-authored-by: Eric Harper <complex451@gmail.com> * [TTS] incremented the version number to 22.08 in tutorials. (NVIDIA#4684) * [TTS] incremented the version number to 22.08 in tutorials. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Megatron encode function with RPE fix (NVIDIA#4692) * Fix for RPE Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * fix to fetch config file (NVIDIA#4699) Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * Fix notebook for buffered inference (NVIDIA#4703) Signed-off-by: smajumdar <smajumdar@nvidia.com> * Prompt Learning Notebook Bug Fix (NVIDIA#4689) * Added back dataset class list of dict input for generation in tutorial notebook Signed-off-by: Virginia Adams <vadams@nvidia.com> * updated argument name for build dataset Signed-off-by: Virginia Adams <vadams@nvidia.com> Signed-off-by: Virginia Adams <vadams@nvidia.com> * add psutils to mock imports (NVIDIA#4728) Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: ericharper <complex451@gmail.com> * Update Aligner model and tutorial to add NGC checkpoint loading (NVIDIA#4714) * Update Aligner model and tutorial to add NGC checkpoint loading Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> * Fix pynini install for Aligner notebook, minor formatting fix for model Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> * Aligner notebook formatting consistency Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * [TTS] bugfix for missing configs. (NVIDIA#4725) Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * docs typo fix Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * Fix pynini install in TTS tutorials (NVIDIA#4729) Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> * Fix ASR notebooks (NVIDIA#4738) Signed-off-by: smajumdar <smajumdar@nvidia.com> Signed-off-by: smajumdar <smajumdar@nvidia.com> * Multilingual VAD model (NVIDIA#4734) * add ngc link Signed-off-by: fayejf <fayejf07@gmail.com> * add tuned VAD config on ASR data Signed-off-by: fayejf <fayejf07@gmail.com> * yaml note Signed-off-by: fayejf <fayejf07@gmail.com> * update vad asr notebook with mVAD Signed-off-by: fayejf <fayejf07@gmail.com> * update vad infer config comment Signed-off-by: fayejf <fayejf07@gmail.com> * fix Signed-off-by: fayejf <fayejf07@gmail.com> * mvad sd config for ch109 Signed-off-by: fayejf <fayejf07@gmail.com> * update sd readme Signed-off-by: fayejf <fayejf07@gmail.com> * add new mVAD model to doc Signed-off-by: fayejf <fayejf07@gmail.com> * style fix Signed-off-by: fayejf <fayejf07@gmail.com> * update sd tutorial with mVAD Signed-off-by: fayejf <fayejf07@gmail.com> * typo fix Signed-off-by: fayejf <fayejf07@gmail.com> Signed-off-by: fayejf <fayejf07@gmail.com> * publish pretrained itn t5 model for English (NVIDIA#4748) Signed-off-by: Alexandra Antonova <aleksandraa@nvidia.com> Signed-off-by: Alexandra Antonova <aleksandraa@nvidia.com> Co-authored-by: Alexandra Antonova <aleksandraa@nvidia.com> * Updated docs and doc paths (NVIDIA#4754) * Updated docs and doc paths Signed-off-by: Virginia Adams <vadams@nvidia.com> * Update Multitask_Prompt_and_PTuning.ipynb * Update README.rst * Changed branch name to use single quotes Signed-off-by: Virginia Adams <vadams@nvidia.com> Signed-off-by: Virginia Adams <vadams@nvidia.com> * fix bug relating to ddp strategy in joint intent slot classification tutorial (NVIDIA#4762) * [TTS] updated config with a German IPA phoneme tokenizer (NVIDIA#4756) * [TTS] added a German IPA phoneme tokenizer * [TTS][ASR] enabled customized arguments for trimming the leading and trailing silence. * [TTS] disabled spline interpolation for beta-binomial distribution. Let it generate align prior and save to disks. Use a new phoneme tokenizer. * [TTS] use consistent spline interpolation with fastpitch checkpoint when generating mel-spectrograms for hifigan finetune. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Update r1.11 to new heteronyms list (NVIDIA#4745) * Update configs to new heteronyms list * Remove old heteronyms list, add alt 'merchandise' pron to CMUdict * Update remaining references to old heteronyms list Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * [TTS] Add multi-speaker German FastPitch and HiFiGAN NGC checkpoints (NVIDIA#4763) Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * [TTS] Add single male speaker German FastPitch and HiFiGAN NGC checkpoints (NVIDIA#4770) Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Update CMUdict with more recent 0.7b entries (NVIDIA#4768) Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Install pynini in docker container (NVIDIA#4733) Signed-off-by: Vladimir Bataev <vbataev@nvidia.com> Signed-off-by: Vladimir Bataev <vbataev@nvidia.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Co-authored-by: Eric Harper <complex451@gmail.com> * Fix tutorial formatting (NVIDIA#4778) Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> * [TTS] deprecated old scripts for ljspeech. (NVIDIA#4780) * deprecated old scripts for ljspeech. * removed relevent function calls in TTS docs. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * update branch Signed-off-by: ericharper <complex451@gmail.com> * update package info and requirements Signed-off-by: ericharper <complex451@gmail.com> * update container Signed-off-by: ericharper <complex451@gmail.com> * Update stragglers to new cmudict and heteronyms paths Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> Signed-off-by: smajumdar <smajumdar@nvidia.com> Signed-off-by: Virginia Adams <vadams@nvidia.com> Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: fayejf <fayejf07@gmail.com> Signed-off-by: Alexandra Antonova <aleksandraa@nvidia.com> Signed-off-by: Vladimir Bataev <vbataev@nvidia.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Co-authored-by: Rajesh Ilango <rilango@gmail.com> Co-authored-by: Micha Livne <michalivne@users.noreply.github.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: Virginia Adams <78445382+vadam5@users.noreply.github.com> Co-authored-by: Jocelyn <jocelynh@nvidia.com> Co-authored-by: fayejf <36722593+fayejf@users.noreply.github.com> Co-authored-by: bene-ges <61418381+bene-ges@users.noreply.github.com> Co-authored-by: Alexandra Antonova <aleksandraa@nvidia.com> Co-authored-by: Zhilin Wang <wangzhilin12061996@hotmail.com> Co-authored-by: Vladimir Bataev <vbataev@nvidia.com> Signed-off-by: Hainan Xu <hainanx@nvidia.com>
hainan-xv
pushed a commit
to hainan-xv/NeMo
that referenced
this pull request
Nov 29, 2022
* Enc-Dec RPE PP > 2 Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Syle Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * update branch Signed-off-by: ericharper <complex451@gmail.com> * update package info and dockerfile Signed-off-by: ericharper <complex451@gmail.com> * fix fastpitch export (NVIDIA#4676) Signed-off-by: Jason <jasoli@nvidia.com> * [TTS] fixed wrong pronunciations for r1.11. (NVIDIA#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Fix for incorrect batch size issue while decoding (NVIDIA#4675) Co-authored-by: Micha Livne <michalivne@users.noreply.github.com> Co-authored-by: Eric Harper <complex451@gmail.com> * [TTS] incremented the version number to 22.08 in tutorials. (NVIDIA#4684) * [TTS] incremented the version number to 22.08 in tutorials. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Megatron encode function with RPE fix (NVIDIA#4692) * Fix for RPE Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * fix to fetch config file (NVIDIA#4699) Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix rpe check Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Revert to main Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Revert more files Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Additional changes to make PP>2 with RPE work. * Fixes for O2 Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fixes Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Update Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix cross attention sync check Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix zero init Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Modify .data instead of the weight Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Add worker changes Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Set workers to 0 for validation and test Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Remove unused imports and allreduce func Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Revert workers change Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> Co-authored-by: ericharper <complex451@gmail.com> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Co-authored-by: Rajesh Ilango <rilango@gmail.com> Co-authored-by: Micha Livne <michalivne@users.noreply.github.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: Hoo Chang Shin <hshin@nvidia.com> Co-authored-by: khcs <khcs@users.noreply.github.com> Signed-off-by: Hainan Xu <hainanx@nvidia.com>
hainan-xv
pushed a commit
to hainan-xv/NeMo
that referenced
this pull request
Nov 29, 2022
* NeMo Megatron doc updates Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * update branch Signed-off-by: ericharper <complex451@gmail.com> * update package info and dockerfile Signed-off-by: ericharper <complex451@gmail.com> * fix fastpitch export (NVIDIA#4676) Signed-off-by: Jason <jasoli@nvidia.com> * [TTS] fixed wrong pronunciations for r1.11. (NVIDIA#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Fix for incorrect batch size issue while decoding (NVIDIA#4675) Co-authored-by: Micha Livne <michalivne@users.noreply.github.com> Co-authored-by: Eric Harper <complex451@gmail.com> * [TTS] incremented the version number to 22.08 in tutorials. (NVIDIA#4684) * [TTS] incremented the version number to 22.08 in tutorials. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Megatron encode function with RPE fix (NVIDIA#4692) * Fix for RPE Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * fix to fetch config file (NVIDIA#4699) Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * Fix notebook for buffered inference (NVIDIA#4703) Signed-off-by: smajumdar <smajumdar@nvidia.com> * Prompt Learning Notebook Bug Fix (NVIDIA#4689) * Added back dataset class list of dict input for generation in tutorial notebook Signed-off-by: Virginia Adams <vadams@nvidia.com> * updated argument name for build dataset Signed-off-by: Virginia Adams <vadams@nvidia.com> Signed-off-by: Virginia Adams <vadams@nvidia.com> * add psutils to mock imports (NVIDIA#4728) Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: ericharper <complex451@gmail.com> * Update Aligner model and tutorial to add NGC checkpoint loading (NVIDIA#4714) * Update Aligner model and tutorial to add NGC checkpoint loading Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> * Fix pynini install for Aligner notebook, minor formatting fix for model Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> * Aligner notebook formatting consistency Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * [TTS] bugfix for missing configs. (NVIDIA#4725) Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * docs typo fix Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * Fix pynini install in TTS tutorials (NVIDIA#4729) Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> * Fix ASR notebooks (NVIDIA#4738) Signed-off-by: smajumdar <smajumdar@nvidia.com> Signed-off-by: smajumdar <smajumdar@nvidia.com> * Multilingual VAD model (NVIDIA#4734) * add ngc link Signed-off-by: fayejf <fayejf07@gmail.com> * add tuned VAD config on ASR data Signed-off-by: fayejf <fayejf07@gmail.com> * yaml note Signed-off-by: fayejf <fayejf07@gmail.com> * update vad asr notebook with mVAD Signed-off-by: fayejf <fayejf07@gmail.com> * update vad infer config comment Signed-off-by: fayejf <fayejf07@gmail.com> * fix Signed-off-by: fayejf <fayejf07@gmail.com> * mvad sd config for ch109 Signed-off-by: fayejf <fayejf07@gmail.com> * update sd readme Signed-off-by: fayejf <fayejf07@gmail.com> * add new mVAD model to doc Signed-off-by: fayejf <fayejf07@gmail.com> * style fix Signed-off-by: fayejf <fayejf07@gmail.com> * update sd tutorial with mVAD Signed-off-by: fayejf <fayejf07@gmail.com> * typo fix Signed-off-by: fayejf <fayejf07@gmail.com> Signed-off-by: fayejf <fayejf07@gmail.com> * publish pretrained itn t5 model for English (NVIDIA#4748) Signed-off-by: Alexandra Antonova <aleksandraa@nvidia.com> Signed-off-by: Alexandra Antonova <aleksandraa@nvidia.com> Co-authored-by: Alexandra Antonova <aleksandraa@nvidia.com> * Updated docs and doc paths (NVIDIA#4754) * Updated docs and doc paths Signed-off-by: Virginia Adams <vadams@nvidia.com> * Update Multitask_Prompt_and_PTuning.ipynb * Update README.rst * Changed branch name to use single quotes Signed-off-by: Virginia Adams <vadams@nvidia.com> Signed-off-by: Virginia Adams <vadams@nvidia.com> * fix bug relating to ddp strategy in joint intent slot classification tutorial (NVIDIA#4762) * [TTS] updated config with a German IPA phoneme tokenizer (NVIDIA#4756) * [TTS] added a German IPA phoneme tokenizer * [TTS][ASR] enabled customized arguments for trimming the leading and trailing silence. * [TTS] disabled spline interpolation for beta-binomial distribution. Let it generate align prior and save to disks. Use a new phoneme tokenizer. * [TTS] use consistent spline interpolation with fastpitch checkpoint when generating mel-spectrograms for hifigan finetune. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Update r1.11 to new heteronyms list (NVIDIA#4745) * Update configs to new heteronyms list * Remove old heteronyms list, add alt 'merchandise' pron to CMUdict * Update remaining references to old heteronyms list Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * [TTS] Add multi-speaker German FastPitch and HiFiGAN NGC checkpoints (NVIDIA#4763) Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * [TTS] Add single male speaker German FastPitch and HiFiGAN NGC checkpoints (NVIDIA#4770) Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Update CMUdict with more recent 0.7b entries (NVIDIA#4768) Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Install pynini in docker container (NVIDIA#4733) Signed-off-by: Vladimir Bataev <vbataev@nvidia.com> Signed-off-by: Vladimir Bataev <vbataev@nvidia.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Co-authored-by: Eric Harper <complex451@gmail.com> * Fix tutorial formatting (NVIDIA#4778) Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> * [TTS] deprecated old scripts for ljspeech. (NVIDIA#4780) * deprecated old scripts for ljspeech. * removed relevent function calls in TTS docs. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * update branch Signed-off-by: ericharper <complex451@gmail.com> * update package info and requirements Signed-off-by: ericharper <complex451@gmail.com> * update container Signed-off-by: ericharper <complex451@gmail.com> * Update stragglers to new cmudict and heteronyms paths Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> Signed-off-by: smajumdar <smajumdar@nvidia.com> Signed-off-by: Virginia Adams <vadams@nvidia.com> Signed-off-by: Jocelyn Huang <jocelynh@nvidia.com> Signed-off-by: fayejf <fayejf07@gmail.com> Signed-off-by: Alexandra Antonova <aleksandraa@nvidia.com> Signed-off-by: Vladimir Bataev <vbataev@nvidia.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Co-authored-by: Rajesh Ilango <rilango@gmail.com> Co-authored-by: Micha Livne <michalivne@users.noreply.github.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: Virginia Adams <78445382+vadam5@users.noreply.github.com> Co-authored-by: Jocelyn <jocelynh@nvidia.com> Co-authored-by: fayejf <36722593+fayejf@users.noreply.github.com> Co-authored-by: bene-ges <61418381+bene-ges@users.noreply.github.com> Co-authored-by: Alexandra Antonova <aleksandraa@nvidia.com> Co-authored-by: Zhilin Wang <wangzhilin12061996@hotmail.com> Co-authored-by: Vladimir Bataev <vbataev@nvidia.com> Signed-off-by: Hainan Xu <hainanx@nvidia.com>
hainan-xv
pushed a commit
to hainan-xv/NeMo
that referenced
this pull request
Nov 29, 2022
* Enc-Dec RPE PP > 2 Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Syle Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * update branch Signed-off-by: ericharper <complex451@gmail.com> * update package info and dockerfile Signed-off-by: ericharper <complex451@gmail.com> * fix fastpitch export (NVIDIA#4676) Signed-off-by: Jason <jasoli@nvidia.com> * [TTS] fixed wrong pronunciations for r1.11. (NVIDIA#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Fix for incorrect batch size issue while decoding (NVIDIA#4675) Co-authored-by: Micha Livne <michalivne@users.noreply.github.com> Co-authored-by: Eric Harper <complex451@gmail.com> * [TTS] incremented the version number to 22.08 in tutorials. (NVIDIA#4684) * [TTS] incremented the version number to 22.08 in tutorials. Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> * Megatron encode function with RPE fix (NVIDIA#4692) * Fix for RPE Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * fix to fetch config file (NVIDIA#4699) Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix rpe check Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Revert to main Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Revert more files Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Additional changes to make PP>2 with RPE work. * Fixes for O2 Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fixes Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Update Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix cross attention sync check Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix zero init Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Modify .data instead of the weight Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Add worker changes Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Set workers to 0 for validation and test Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Remove unused imports and allreduce func Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Style Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Revert workers change Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> Co-authored-by: ericharper <complex451@gmail.com> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com> Co-authored-by: Rajesh Ilango <rilango@gmail.com> Co-authored-by: Micha Livne <michalivne@users.noreply.github.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: Hoo Chang Shin <hshin@nvidia.com> Co-authored-by: khcs <khcs@users.noreply.github.com> Signed-off-by: Hainan Xu <hainanx@nvidia.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What does this PR do ?
Fixes a bug with RPE and encode() in token_level_encoder_decoder.
Collection: NLP
Changelog
enc_self_attention_relative_position_biasto theself.encoder()call inmegatron_encoder_decoder.pyUsage
# Add a code snippet demonstrating how to use thisBefore your PR is "Ready for review"
Pre checks:
PR Type:
If you haven't finished some of the above items you can still open "Draft" PR.
Who can review?
Anyone in the community is free to review the PR once the checks have passed.
Contributor guidelines contains specific people who can review PRs to various areas.
Additional Information