Skip to content

Fix AST eval#8112

Merged
stevehuang52 merged 8 commits intomainfrom
add_text_metrics_evaluator
Jan 10, 2024
Merged

Fix AST eval#8112
stevehuang52 merged 8 commits intomainfrom
add_text_metrics_evaluator

Conversation

@stevehuang52
Copy link
Collaborator

Fix bleu calculation for ASR evaluator

stevehuang52 and others added 5 commits December 27, 2023 09:50
Signed-off-by: stevehuang52 <heh@nvidia.com>
Signed-off-by: stevehuang52 <heh@nvidia.com>
Signed-off-by: stevehuang52 <heh@nvidia.com>
@stevehuang52 stevehuang52 requested a review from fayejf January 2, 2024 22:23
@github-actions github-actions bot added the ASR label Jan 2, 2024
fayejf
fayejf previously approved these changes Jan 2, 2024
Copy link
Collaborator

@fayejf fayejf left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM thanks

@stevehuang52
Copy link
Collaborator Author

jenkins

Signed-off-by: stevehuang52 <heh@nvidia.com>
@stevehuang52
Copy link
Collaborator Author

jenkins

)
if gt_text_attr_name not in sample:
if "text" in sample:
gt_text_attr_name = "text"

Check notice

Code scanning / CodeQL

Unused local variable

Variable gt_text_attr_name is not used.
f"ground-truth text attribute {pred_text_attr_name} is not present in manifest! Cannot calculate {metric}. Returning!"
)
if "text" in sample:
gt_text_attr_name = "text"

Check notice

Code scanning / CodeQL

Unused local variable

Variable gt_text_attr_name is not used.
@stevehuang52 stevehuang52 requested a review from fayejf January 3, 2024 23:32
Copy link
Collaborator

@fayejf fayejf left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@stevehuang52
Copy link
Collaborator Author

jenkins

@stevehuang52 stevehuang52 merged commit bd47c5c into main Jan 10, 2024
@stevehuang52 stevehuang52 deleted the add_text_metrics_evaluator branch January 10, 2024 17:04
minitu pushed a commit to minitu/NeMo that referenced this pull request Jan 19, 2024
* add text metrics to asr eval

Signed-off-by: stevehuang52 <heh@nvidia.com>

* temporary fix for EncDecTransfModelBPE

Signed-off-by: stevehuang52 <heh@nvidia.com>

* fix bleu eval

Signed-off-by: stevehuang52 <heh@nvidia.com>

* fix typo

Signed-off-by: stevehuang52 <heh@nvidia.com>

---------

Signed-off-by: stevehuang52 <heh@nvidia.com>
Co-authored-by: fayejf <36722593+fayejf@users.noreply.github.com>
ssh-meister pushed a commit to ssh-meister/NeMo that referenced this pull request Feb 15, 2024
* add text metrics to asr eval

Signed-off-by: stevehuang52 <heh@nvidia.com>

* temporary fix for EncDecTransfModelBPE

Signed-off-by: stevehuang52 <heh@nvidia.com>

* fix bleu eval

Signed-off-by: stevehuang52 <heh@nvidia.com>

* fix typo

Signed-off-by: stevehuang52 <heh@nvidia.com>

---------

Signed-off-by: stevehuang52 <heh@nvidia.com>
Co-authored-by: fayejf <36722593+fayejf@users.noreply.github.com>
Signed-off-by: Sasha Meister <ameister@nvidia.com>
rohitrango pushed a commit to rohitrango/NeMo that referenced this pull request Jun 25, 2024
* add text metrics to asr eval

Signed-off-by: stevehuang52 <heh@nvidia.com>

* temporary fix for EncDecTransfModelBPE

Signed-off-by: stevehuang52 <heh@nvidia.com>

* fix bleu eval

Signed-off-by: stevehuang52 <heh@nvidia.com>

* fix typo

Signed-off-by: stevehuang52 <heh@nvidia.com>

---------

Signed-off-by: stevehuang52 <heh@nvidia.com>
Co-authored-by: fayejf <36722593+fayejf@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants