Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Efficient streaming decoding for RNN-T and TDT (support partial hypotheses) #9106

Draft
wants to merge 10 commits into
base: main
Choose a base branch
from
Draft

Efficient streaming decoding for RNN-T and TDT (support partial hypotheses) #9106

wants to merge 10 commits into from

Commits on May 3, 2024

  1. Support previous hidden state and labels passing for RNN-T and TDT (L… 

    …abel-Looping algorithm)

Signed-off-by: Vladimir Bataev <vbataev@nvidia.com>
    @artbataev
    artbataev committed May 3, 2024
    Configuration menu
    Copy the full SHA
    fb7c079 View commit details
    Browse the repository at this point in the history

  2. Partial hypotheses support for RNN-T 

    Signed-off-by: Vladimir Bataev <vbataev@nvidia.com>
    @artbataev
    artbataev committed May 3, 2024
    Configuration menu
    Copy the full SHA
    4e6e07c View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2024

  1. Merge branch 'main' into support_partial_hypotheses 

    # Conflicts:
#	nemo/collections/asr/parts/submodules/rnnt_loop_labels_computer.py
#	nemo/collections/asr/parts/submodules/tdt_loop_labels_computer.py
    @artbataev
    artbataev committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    357b9a8 View commit details
    Browse the repository at this point in the history

  2. Add todo 

    Signed-off-by: Vladimir Bataev <vbataev@nvidia.com>
    @artbataev
    artbataev committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    02df5ed View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2024

  1. Fix returning state 

    Signed-off-by: Vladimir Bataev <vbataev@nvidia.com>
    @artbataev
    artbataev committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    e7c6a14 View commit details
    Browse the repository at this point in the history

  2. Allow custom strategy 

    Signed-off-by: Vladimir Bataev <vbataev@nvidia.com>
    @artbataev
    artbataev committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    257c5f9 View commit details
    Browse the repository at this point in the history

  3. Fix issues with CUDA graphs + streaming 

    Signed-off-by: Vladimir Bataev <vbataev@nvidia.com>
    @artbataev
    artbataev committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    9370179 View commit details
    Browse the repository at this point in the history

  4. Enable CUDA graphs 

    Signed-off-by: Vladimir Bataev <vbataev@nvidia.com>
    @artbataev
    artbataev committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    0d2a991 View commit details
    Browse the repository at this point in the history

  5. Fix previous state and labels handling for incomplete batch 

    Signed-off-by: Vladimir Bataev <vbataev@nvidia.com>
    @artbataev
    artbataev committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    7b66672 View commit details
    Browse the repository at this point in the history

  6. Apply isort and black reformatting 

    Signed-off-by: artbataev <artbataev@users.noreply.github.com>
    @artbataev
    artbataev committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    d4e310a View commit details
    Browse the repository at this point in the history