Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
* refactor dataset utils Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * black fix Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * refactor datasets Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * import fixes Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * import fix Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * import fix Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * black fix Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * import fixes Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * wip black fix Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * import fixed Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * import fixed Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * trade example fix Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * utils refacoting Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * text_cl fixed Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * rm output Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * glue fix, jenkins updated Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * revert jenkins Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * Removed CrossEntropy3D. Merged PaddedSmoothedCrossEntropyLossNM with MaskedLanguageModelingLossNM into unified SmoothedCrossEntropyLossNM. Moved SmoothedCrossEntropyLoss into the file for SmoothedCrossEntropyLossNM. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Fixed bug. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Fixed style. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * wikitext down fixed, jenkins update Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * Loss names updated. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Fixed bugs. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Fixed bugs. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * jenkins Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * Fixed targets_id bug. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * jenkins update Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * jenkins update Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * jenkins update Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * Bug fixed. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Bug fixed. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * DataProcessor class moved to datasets_utils/ Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * Bug fixed. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Style fixed. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Fixed bugs. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Fixed bugs. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Added boolmasktype. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Fixed style. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Fixed style. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Remove vocab file in jenkins. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Added boolmasktype. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Styel fixed. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * bug fixed. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Added optional port to smoothed_cross_entropy_loss Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Added MaskType Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Replaced TokenClassifcaitionLoss with crossentropyloss. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Replaced TokenClassifcaitionLoss with crossentropyloss. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Replaced TokenClassifcaitionLoss with crossentropyloss. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Style fixed. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Removed tokenclassificationloss Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Added back logits_dim to CrossEntropyLoss. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Fixed bug. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Fixed bug. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Fixed bug. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Fixed bug. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Fixed bug. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Fixed bug. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Fixed bug. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Fixed bug. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Fixed bug. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Chnaged crossentropyloss to crossentropylossnm Signed-off-by: VahidooX <vnoroozi@nvidia.com> * refactored and added doc string to data_layers folder Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * Bug fixed. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Bug fixed. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * added doc string to trainables folder file Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * adding header to squad dataset Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * refactored nm folder utils Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * wkt refactored Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * black Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * docstrings added Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * fix bug Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * Bug fixed. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Bug fixed. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Bug fixed. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Bug fixed. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Added weights to lossaggregator. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Added lossaggregator to jointintentsloss. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Added lossaggregator to jointintentsloss. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Added lossaggregator to jointintentsloss. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Style fixed. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Style fixed. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * shuffle removed, lgtm fix Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * Fixed lgtm warnings. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * lgtm fix Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * Moved lossaggregator to backedn.common. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * changelog updated Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * bug fixed Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * jenkins fixed to used the same bert in all tests Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * Fixed comments. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * jenkins bert default fixed Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * Fixed comments. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * deleted unused losses Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * import fix Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * Fixed comments. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * bug fixed Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * Resolved reviews. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * import fixed Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * Updated comments. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * licences updated Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com> * Fixed lgtm warnings. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Fixed lgtm warnings. Signed-off-by: VahidooX <vnoroozi@nvidia.com> * Fixed bug. Signed-off-by: VahidooX <vnoroozi@nvidia.com> Co-authored-by: Vahid Noroozi <VahidooX@users.noreply.github.com> Co-authored-by: Yang Zhang <yzhang123@users.noreply.github.com>
- Loading branch information