Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ssl fixes #4268

Merged
merged 7 commits into from
May 26, 2022
Merged

ssl fixes #4268

merged 7 commits into from
May 26, 2022

Conversation

sam1373
Copy link
Contributor

@sam1373 sam1373 commented May 25, 2022

Signed-off-by: sam1373 samuelkriman@gmail.com

What does this PR do ?

  • fixes masked patch augmentation to round up to guarantee specified fraction of masked steps
  • updates to citrinet and contextnet ssl configs and relevant decoder
  • fixes tutorial to work with updated configs + minor changes
  • revert rnnt decoding change since it's not needed at the moment

Collection: ASR

PR Type:

  • New Feature
  • Bugfix
  • Documentation

Signed-off-by: sam1373 <samuelkriman@gmail.com>
Signed-off-by: sam1373 <samuelkriman@gmail.com>
@sam1373 sam1373 marked this pull request as ready for review May 26, 2022 01:09
Copy link
Collaborator

@titu1994 titu1994 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Neural type needs to be updated, rest all looks good.

return self.decoder_layers(encoder_output).transpose(-2, -1)
out = self.decoder_layers(encoder_output).transpose(-2, -1)
if self.apply_softmax:
out = torch.nn.functional.log_softmax(out, dim=-1)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You need to update the output_types neural type of this module - when the flag is set to false, it returns logits, when true, log probs. It is important to update the semantics of this module and any downstream modules that accept the output of this class.

Signed-off-by: sam1373 <samuelkriman@gmail.com>
Signed-off-by: sam1373 <samuelkriman@gmail.com>
Signed-off-by: sam1373 <samuelkriman@gmail.com>
Copy link
Collaborator

@titu1994 titu1994 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good

@sam1373 sam1373 merged commit dfcf9b2 into NVIDIA:main May 26, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants