Add SSL import functionality for Audio Lexical PNC Models

[trias702]

Signed-off-by: Daniel Egert degert@nvidia.com

What does this PR do ?

This PR allows the audio lexical PNC model to also import pretrained SSL models for the audio encoder, and allows importing any audio encoder which is on disk, and not just on NGC

Collection: [Note which collection this PR will affect]
NLP

Changelog

• Changes punctuation_capitalization_lexical_audio_model.py to support .restore_from instead of just .from_pretrained
• Changes punctuation_capitalization_lexical_audio_model.py to support SSL models for the encoder by correct removing the SSL decoder_losses
• Changes punctuation_capitalization_model.py to support inference with a list of bytes instead of just list of strings for audio filepaths on disk. This allows using a bytestream which is necessary for Riva sharded tar files
• Changes punctuation_capitalization_infer_dataset.py to support the same bytestream changes
• Changes punctuation_capitalization_model.py to remove superfluous debug print statements outside nemo logging which were accidentally left in

Usage

You can now specify model.audio_encoder.pretrained_model to be a .nemo file on disk rather than just the name of a model in NGC. This is set in the config yaml of the audio lexical model.

model:
  audio_encoder:
    pretrained_model: /path/to/my_ssl_model.nemo  # this now works
    freeze:
      is_enabled: false # If set to True weights of audio encoder will not be updated during training.
      d_model: 256 # Input dimension of MultiheadAttentionMechanism and PositionwiseFeedForward
      d_ff: 1024 # Hidden dimension of PositionwiseFeedForward
      num_layers: 4 # Number of additional Conformer layers

Before your PR is "Ready for review"

Pre checks:

• Make sure you read and followed Contributor guidelines
• Did you write any new necessary tests?
• Did you add or update any necessary documentation?
• Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  • Reviewer: Does the PR have correct import guards for all optional libraries?

PR Type:

• New Feature
• Bugfix
• Documentation

If you haven't finished some of the above items you can still open "Draft" PR.

Who can review?

Anyone in the community is free to review the PR once the checks have passed.
Contributor guidelines contains specific people who can review PRs to various areas.

Additional Information

• Related to # (issue)

[jubick1337]

LGTM just minor changes