Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding Conformer model #1327

Merged
merged 75 commits into from Nov 3, 2020
Merged

Adding Conformer model #1327

merged 75 commits into from Nov 3, 2020

Commits on Oct 21, 2020

  1. Added initial code of Conformer. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 21, 2020
    Configuration menu
    Copy the full SHA
    543466b View commit details
    Browse the repository at this point in the history

  2. Added initial code of Conformer. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 21, 2020
    Configuration menu
    Copy the full SHA
    99e9233 View commit details
    Browse the repository at this point in the history

  3. Added log_every_n_steps. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 21, 2020
    Configuration menu
    Copy the full SHA
    428a72d View commit details
    Browse the repository at this point in the history

  4. dropped older multi_head_att modules. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 21, 2020
    Configuration menu
    Copy the full SHA
    56770ad View commit details
    Browse the repository at this point in the history

  5. Dropped dropout_in and params. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 21, 2020
    Configuration menu
    Copy the full SHA
    7213125 View commit details
    Browse the repository at this point in the history

  6. Fixed code style. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 21, 2020
    Configuration menu
    Copy the full SHA
    a4c4c79 View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2020

  1. Updated docs. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 22, 2020
    Configuration menu
    Copy the full SHA
    2c900aa View commit details
    Browse the repository at this point in the history

  2. Removed unused import. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 22, 2020
    Configuration menu
    Copy the full SHA
    ac86cb3 View commit details
    Browse the repository at this point in the history

  3. fixed docs. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 22, 2020
    Configuration menu
    Copy the full SHA
    75aa1e4 View commit details
    Browse the repository at this point in the history

  4. Fixed license header. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 22, 2020
    Configuration menu
    Copy the full SHA
    25fff7f View commit details
    Browse the repository at this point in the history

  5. Fixed license header. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 22, 2020
    Configuration menu
    Copy the full SHA
    09d217c View commit details
    Browse the repository at this point in the history

  6. fixed style. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 22, 2020
    Configuration menu
    Copy the full SHA
    cda38ae View commit details
    Browse the repository at this point in the history

  7. Updated tests with _target_. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 22, 2020
    Configuration menu
    Copy the full SHA
    c24b0f6 View commit details
    Browse the repository at this point in the history

  8. Updated tests with _target_. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 22, 2020
    Configuration menu
    Copy the full SHA
    7a61905 View commit details
    Browse the repository at this point in the history

  9. Fixed style. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 22, 2020
    Configuration menu
    Copy the full SHA
    9420578 View commit details
    Browse the repository at this point in the history

  10. Merge branch 'main' of https://github.com/NVIDIA/NeMo into add_confor… 

    …mer3
    @VahidooX
    VahidooX committed Oct 22, 2020
    Configuration menu
    Copy the full SHA
    ef7a236 View commit details
    Browse the repository at this point in the history

  11. Fixed style. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 22, 2020
    Configuration menu
    Copy the full SHA
    3402668 View commit details
    Browse the repository at this point in the history

  12. Merge branch 'main' of https://github.com/NVIDIA/NeMo into add_confor… 

    …mer3

Signed-off-by: Vahid <vnoroozi@nvidia.com>

# Conflicts:
#	nemo/collections/asr/modules/__init__.py
    @VahidooX
    VahidooX committed Oct 22, 2020
    Configuration menu
    Copy the full SHA
    9c4993d View commit details
    Browse the repository at this point in the history

  13. Fixed missing params. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 22, 2020
    Configuration menu
    Copy the full SHA
    fb324d0 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2020

  1. Fixed missing params. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 23, 2020
    Configuration menu
    Copy the full SHA
    93adc1a View commit details
    Browse the repository at this point in the history

  2. Dropped u and v biases. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 23, 2020
    Configuration menu
    Copy the full SHA
    2473812 View commit details
    Browse the repository at this point in the history

  3. Fixed params. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 23, 2020
    Configuration menu
    Copy the full SHA
    1653599 View commit details
    Browse the repository at this point in the history

  4. moved back padding in features.py. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 23, 2020
    Configuration menu
    Copy the full SHA
    81dff89 View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2020

  1. fixed optimzier. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 26, 2020
    Configuration menu
    Copy the full SHA
    ea93557 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of https://github.com/NVIDIA/NeMo into add_confor… 

    …mer3
    @VahidooX
    VahidooX committed Oct 26, 2020
    Configuration menu
    Copy the full SHA
    f6787c0 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' of https://github.com/NVIDIA/NeMo into add_confor… 

    …mer3
    @VahidooX
    VahidooX committed Oct 26, 2020
    Configuration menu
    Copy the full SHA
    7c0fe36 View commit details
    Browse the repository at this point in the history

  4. fixed vocab bug. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 26, 2020
    Configuration menu
    Copy the full SHA
    a7c7207 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2020

  1. added load_weights_from_checkpoint. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 27, 2020
    Configuration menu
    Copy the full SHA
    3ceeebd View commit details
    Browse the repository at this point in the history

  2. Added jenkins test for Conformer. Updated names from bpe to subword. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 27, 2020
    Configuration menu
    Copy the full SHA
    acfb8e6 View commit details
    Browse the repository at this point in the history

  3. Added jenkins test for Conformer. Updated names from bpe to subword. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 27, 2020
    Configuration menu
    Copy the full SHA
    fd8764a View commit details
    Browse the repository at this point in the history

  4. enabled ddp. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 27, 2020
    Configuration menu
    Copy the full SHA
    5f241d4 View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2020

  1. removed extra prints. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 28, 2020
    Configuration menu
    Copy the full SHA
    f0cae87 View commit details
    Browse the repository at this point in the history

Commits on Oct 29, 2020

  1. reorg the folders. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 29, 2020
    Configuration menu
    Copy the full SHA
    b625c95 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2020

  1. reorg the folders. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    09ee00f View commit details
    Browse the repository at this point in the history

  2. reorg the folders. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    cdfd2ec View commit details
    Browse the repository at this point in the history

  3. reorg the folders. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    b0f22cf View commit details
    Browse the repository at this point in the history

  4. reverted back subword. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    175cd48 View commit details
    Browse the repository at this point in the history

  5. reverted back subword. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    0efb275 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' of https://github.com/NVIDIA/NeMo into add_confor… 

    …mer3

Signed-off-by: Vahid <vnoroozi@nvidia.com>

# Conflicts:
#	Jenkinsfile
    @VahidooX
    VahidooX committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    fe40839 View commit details
    Browse the repository at this point in the history

  7. updated test evaluation. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    c6b5b3c View commit details
    Browse the repository at this point in the history

  8. Updated the code. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    e60bc15 View commit details
    Browse the repository at this point in the history

  9. fixed the style. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    8ea849b View commit details
    Browse the repository at this point in the history

  10. Added docstring. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    be08878 View commit details
    Browse the repository at this point in the history

  11. dropped load_weights. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    d1ed640 View commit details
    Browse the repository at this point in the history

  12. fixed feat_out. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    c5922ac View commit details
    Browse the repository at this point in the history

  13. fixed feat_out. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    58b85f0 View commit details
    Browse the repository at this point in the history

  14. dropped the vocab files. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    42fea11 View commit details
    Browse the repository at this point in the history

  15. fixed the bug. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    c28b312 View commit details
    Browse the repository at this point in the history

  16. added logging of config. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    4283e97 View commit details
    Browse the repository at this point in the history

  17. moved swish to activations. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    83ef7e1 View commit details
    Browse the repository at this point in the history

  18. fixed to_yaml. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    2ccbb6a View commit details
    Browse the repository at this point in the history

  19. fixed the feat_in bug. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    4d04686 View commit details
    Browse the repository at this point in the history

  20. Merge branch 'main' of https://github.com/NVIDIA/NeMo into add_confor… 

    …mer3
    @VahidooX
    VahidooX committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    927f82b View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2020

  1. fixed the feat_in bug. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 31, 2020
    Configuration menu
    Copy the full SHA
    7d859fe View commit details
    Browse the repository at this point in the history

  2. fixed the feat_in bug. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 31, 2020
    Configuration menu
    Copy the full SHA
    a164748 View commit details
    Browse the repository at this point in the history

  3. fixed the feat_in bug. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 31, 2020
    Configuration menu
    Copy the full SHA
    8c92c54 View commit details
    Browse the repository at this point in the history

  4. fixed the feat_in bug. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 31, 2020
    Configuration menu
    Copy the full SHA
    d929c1d View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' of https://github.com/NVIDIA/NeMo into add_confor… 

    …mer3
    @VahidooX
    VahidooX committed Oct 31, 2020
    Configuration menu
    Copy the full SHA
    b4a28f9 View commit details
    Browse the repository at this point in the history

  6. fixed the feat_in bug. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 31, 2020
    Configuration menu
    Copy the full SHA
    f336ed9 View commit details
    Browse the repository at this point in the history

  7. fixed the feat_in bug. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 31, 2020
    Configuration menu
    Copy the full SHA
    dbfe71e View commit details
    Browse the repository at this point in the history

  8. fixed the feat_in bug. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 31, 2020
    Configuration menu
    Copy the full SHA
    5a0cf54 View commit details
    Browse the repository at this point in the history

  9. fixed the feat_in bug. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Oct 31, 2020
    Configuration menu
    Copy the full SHA
    6791136 View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2020

  1. fixed the feat_in bug. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Nov 2, 2020
    Configuration menu
    Copy the full SHA
    dfeafd1 View commit details
    Browse the repository at this point in the history

  2. fixed log_predciction. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Nov 2, 2020
    Configuration menu
    Copy the full SHA
    a74a327 View commit details
    Browse the repository at this point in the history

  3. fixed log bug. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Nov 2, 2020
    Configuration menu
    Copy the full SHA
    6600de9 View commit details
    Browse the repository at this point in the history

  4. fixed style. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Nov 2, 2020
    Configuration menu
    Copy the full SHA
    4b314db View commit details
    Browse the repository at this point in the history

  5. added pos_emb_max_len. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Nov 2, 2020
    Configuration menu
    Copy the full SHA
    58f9588 View commit details
    Browse the repository at this point in the history

  6. added pos_emb_max_len. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Nov 2, 2020
    Configuration menu
    Copy the full SHA
    306ddf6 View commit details
    Browse the repository at this point in the history

  7. moved subsampling. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Nov 2, 2020
    Configuration menu
    Copy the full SHA
    7dabb78 View commit details
    Browse the repository at this point in the history

  8. added open_dict() 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Nov 2, 2020
    Configuration menu
    Copy the full SHA
    90cb95c View commit details
    Browse the repository at this point in the history

Commits on Nov 3, 2020

  1. moved conformerblock. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Nov 3, 2020
    Configuration menu
    Copy the full SHA
    353e652 View commit details
    Browse the repository at this point in the history

  2. fixed import bug. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Nov 3, 2020
    Configuration menu
    Copy the full SHA
    5e974b8 View commit details
    Browse the repository at this point in the history

  3. fixed code style. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Nov 3, 2020
    Configuration menu
    Copy the full SHA
    3eef062 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' of https://github.com/NVIDIA/NeMo into add_confor… 

    …mer3
    @VahidooX
    VahidooX committed Nov 3, 2020
    Configuration menu
    Copy the full SHA
    9c1a652 View commit details
    Browse the repository at this point in the history

  5. added conformerencoder to all. 

    Signed-off-by: Vahid <vnoroozi@nvidia.com>
    @VahidooX
    VahidooX committed Nov 3, 2020
    Configuration menu
    Copy the full SHA
    302b9f3 View commit details
    Browse the repository at this point in the history