Skip to content

fix(score): prune rouge scoring function and fix en version of rouge - #1633

Merged
Yunnglin merged 2 commits into
modelscope:mainfrom
Moenupa:fix/rouge-scoring
Aug 26, 2026
Merged

fix(score): prune rouge scoring function and fix en version of rouge#1633
Yunnglin merged 2 commits into
modelscope:mainfrom
Moenupa:fix/rouge-scoring

Conversation

@Moenupa

@Moenupa Moenupa commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

Summary

  • (break) remove unused, over-complicated compute_rouge_score()
  • (fix) compute_rouge_score_one_sample() had inverted reference and prediction.
  • (fix) add safeguards before Rouge functions, preventing strings from going into zip()
  • (feat) add a toggle to strictly match the lengths of ref: list[str] and pred: list[str] defaults to False, the same behavior as before.
  • no tests needed.
  • no doc updated needed.

@Yunnglin
Yunnglin requested a lite review from Copilot August 26, 2026 07:52

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@Yunnglin Yunnglin left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Verified the ROUGE argument-order fix, input safeguards, type annotations, and cleanup. The failing unit test is unrelated to this PR (IQuiz dataset cache/download failure).

@Yunnglin
Yunnglin merged commit 3c80916 into modelscope:main Aug 26, 2026
2 of 3 checks passed
@Moenupa
Moenupa deleted the fix/rouge-scoring branch August 26, 2026 08:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants