-
Notifications
You must be signed in to change notification settings - Fork 642
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Enable log probs input for rnnt loss #2798
Conversation
c78360e
to
9ce76a2
Compare
9ce76a2
to
3f00a4b
Compare
3f00a4b
to
68664dc
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM. thanks @carolineechen for addressing this quickly to unblock @BriansIDP !
@carolineechen has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator. |
@carolineechen has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator. |
ca0c8a5
to
2b3cdc3
Compare
@carolineechen has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator. |
Hey @carolineechen. |
Add
fused_log_softmax
argument (default/current behavior = True) to rnnt loss.If setting it to
False
, calllog_softmax
on the logits prior to passing it in to the rnnt loss function.The following should produce the same output:
testing -- unit tests + get same results on the conformer rnnt recipe