Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Canary support for decoding with return_hypotheses=True #8338

Merged
merged 7 commits into from
Feb 13, 2024

Conversation

stevehuang52
Copy link
Collaborator

@stevehuang52 stevehuang52 commented Feb 5, 2024

What does this PR do ?

  • Add Canary support for decoding with return_hypotheses=True and to return top-k hypotheses

Collection: [asr]

Signed-off-by: stevehuang52 <heh@nvidia.com>
Signed-off-by: stevehuang52 <heh@nvidia.com>
Signed-off-by: stevehuang52 <heh@nvidia.com>
@nithinraok
Copy link
Collaborator

jenkins

@titu1994
Copy link
Collaborator

titu1994 commented Feb 6, 2024

Uh I'm adding support for this in my ASR transcribe refactor

@titu1994
Copy link
Collaborator

titu1994 commented Feb 6, 2024

Actually let's keep this PR open, we'll get it rebased on the transcribe pr

@stevehuang52
Copy link
Collaborator Author

jenkins

Signed-off-by: stevehuang52 <heh@nvidia.com>
@stevehuang52
Copy link
Collaborator Author

jenkins

Copy link
Collaborator

@nithinraok nithinraok left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@stevehuang52 stevehuang52 merged commit a06835f into main Feb 13, 2024
15 checks passed
@stevehuang52 stevehuang52 deleted the canary_patch_decode branch February 13, 2024 22:24
biscayan pushed a commit to biscayan/NeMo that referenced this pull request Feb 15, 2024
)

* change default decoding to beam=1 and length up to decoder max len

Signed-off-by: stevehuang52 <heh@nvidia.com>

* add Canary support for return_hypotheses=True

Signed-off-by: stevehuang52 <heh@nvidia.com>

* change len_pen default to 0

Signed-off-by: stevehuang52 <heh@nvidia.com>

* fix for nbest hypotheses

Signed-off-by: stevehuang52 <heh@nvidia.com>

* fix for return best hypo

Signed-off-by: stevehuang52 <heh@nvidia.com>

---------

Signed-off-by: stevehuang52 <heh@nvidia.com>
Signed-off-by: biscayan <skgudwn34@gmail.com>
ssh-meister pushed a commit to ssh-meister/NeMo that referenced this pull request Feb 15, 2024
)

* change default decoding to beam=1 and length up to decoder max len

Signed-off-by: stevehuang52 <heh@nvidia.com>

* add Canary support for return_hypotheses=True

Signed-off-by: stevehuang52 <heh@nvidia.com>

* change len_pen default to 0

Signed-off-by: stevehuang52 <heh@nvidia.com>

* fix for nbest hypotheses

Signed-off-by: stevehuang52 <heh@nvidia.com>

* fix for return best hypo

Signed-off-by: stevehuang52 <heh@nvidia.com>

---------

Signed-off-by: stevehuang52 <heh@nvidia.com>
Signed-off-by: Sasha Meister <ameister@nvidia.com>
zpx01 pushed a commit to zpx01/NeMo that referenced this pull request Mar 8, 2024
)

* change default decoding to beam=1 and length up to decoder max len

Signed-off-by: stevehuang52 <heh@nvidia.com>

* add Canary support for return_hypotheses=True

Signed-off-by: stevehuang52 <heh@nvidia.com>

* change len_pen default to 0

Signed-off-by: stevehuang52 <heh@nvidia.com>

* fix for nbest hypotheses

Signed-off-by: stevehuang52 <heh@nvidia.com>

* fix for return best hypo

Signed-off-by: stevehuang52 <heh@nvidia.com>

---------

Signed-off-by: stevehuang52 <heh@nvidia.com>
Signed-off-by: Zeeshan Patel <zeeshanp@berkeley.edu>
pablo-garay pushed a commit that referenced this pull request Mar 19, 2024
* change default decoding to beam=1 and length up to decoder max len

Signed-off-by: stevehuang52 <heh@nvidia.com>

* add Canary support for return_hypotheses=True

Signed-off-by: stevehuang52 <heh@nvidia.com>

* change len_pen default to 0

Signed-off-by: stevehuang52 <heh@nvidia.com>

* fix for nbest hypotheses

Signed-off-by: stevehuang52 <heh@nvidia.com>

* fix for return best hypo

Signed-off-by: stevehuang52 <heh@nvidia.com>

---------

Signed-off-by: stevehuang52 <heh@nvidia.com>
Signed-off-by: Pablo Garay <pagaray@nvidia.com>
rohitrango pushed a commit to rohitrango/NeMo that referenced this pull request Jun 25, 2024
)

* change default decoding to beam=1 and length up to decoder max len

Signed-off-by: stevehuang52 <heh@nvidia.com>

* add Canary support for return_hypotheses=True

Signed-off-by: stevehuang52 <heh@nvidia.com>

* change len_pen default to 0

Signed-off-by: stevehuang52 <heh@nvidia.com>

* fix for nbest hypotheses

Signed-off-by: stevehuang52 <heh@nvidia.com>

* fix for return best hypo

Signed-off-by: stevehuang52 <heh@nvidia.com>

---------

Signed-off-by: stevehuang52 <heh@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants