Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Attentionpooling ecapa #2468

Merged
merged 12 commits into from
Jul 14, 2021
Merged

Attentionpooling ecapa #2468

merged 12 commits into from
Jul 14, 2021

Conversation

nithinraok
Copy link
Collaborator

@nithinraok nithinraok commented Jul 12, 2021

  • Adds new modified ecapa ecoder for better speaker embeddings
  • adds attention pooling decoder
  • adds TAP pooling
  • tests

@lgtm-com
Copy link

lgtm-com bot commented Jul 12, 2021

This pull request introduces 1 alert when merging 673b918 into 44a3d02 - view on LGTM.com

new alerts:

  • 1 for Unused import

@lgtm-com
Copy link

lgtm-com bot commented Jul 12, 2021

This pull request introduces 1 alert when merging 558f948 into 44a3d02 - view on LGTM.com

new alerts:

  • 1 for Unused import

examples/speaker_recognition/conf/SpeakerNet_ECAPA.yaml Outdated Show resolved Hide resolved
nemo/collections/asr/modules/conv_asr.py Show resolved Hide resolved
nemo/collections/asr/modules/conv_asr.py Show resolved Hide resolved
nemo/collections/asr/modules/conv_asr.py Outdated Show resolved Hide resolved
nemo/collections/asr/parts/submodules/tdnn_attention.py Outdated Show resolved Hide resolved
nemo/collections/asr/parts/submodules/tdnn_attention.py Outdated Show resolved Hide resolved
nemo/collections/asr/parts/submodules/tdnn_attention.py Outdated Show resolved Hide resolved
'cls': 'nemo.collections.asr.modules.ECAPA_Encoder',
'params': {
'feat_in': 80,
'filters': [1024, 1024, 1024, 1024, 3072],
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Dont use such large filters for tests, it will slow it down.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you are right

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>
Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>
Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>
Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>
Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>
Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>
Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>
Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>
Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>
Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>
Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>
Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>
@titu1994 titu1994 merged commit 6ebbcb8 into main Jul 14, 2021
fayejf pushed a commit that referenced this pull request Jul 16, 2021
* initial_draft

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* group_fix

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* tdnn_block_name_change

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* no masking

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* mask update

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* attentive masking

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* speakernet_name

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* added tests and doc strings

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* added ecapa yaml

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* test and unused variable fix

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* case change and review feedback fixes

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* updated name

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>
titu1994 pushed a commit to titu1994/NeMo that referenced this pull request Jul 20, 2021
* initial_draft

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* group_fix

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* tdnn_block_name_change

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* no masking

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* mask update

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* attentive masking

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* speakernet_name

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* added tests and doc strings

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* added ecapa yaml

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* test and unused variable fix

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* case change and review feedback fixes

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* updated name

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>
@nithinraok nithinraok deleted the attentionpooling_ecapa branch July 21, 2021 02:13
paarthneekhara pushed a commit to paarthneekhara/NeMo that referenced this pull request Sep 17, 2021
* initial_draft

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* group_fix

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* tdnn_block_name_change

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* no masking

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* mask update

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* attentive masking

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* speakernet_name

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* added tests and doc strings

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* added ecapa yaml

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* test and unused variable fix

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* case change and review feedback fixes

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>

* updated name

Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com>
Signed-off-by: Paarth Neekhara <paarth.n@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants