Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix Reference Structure for Basic BLEU calculation #74

Merged
merged 6 commits into from Feb 11, 2022
Merged

Fix Reference Structure for Basic BLEU calculation #74

merged 6 commits into from Feb 11, 2022

Conversation

Sophylax
Copy link
Member

The wrapped function expects a slightly different reference structure than the one we give in the Single Ref-Pred method. A small structure change fixes the issue.

Fixes #72

The wrapped function expects a slightly different reference structure
than the one we give in Single Ref-Pred method. A small structure change
fixes the issue.

Single Pred Multi Ref method no longer calls the previous method to
avoid the unneeded structure change, and instead calculates its BLEU
score directly
@devrimcavusoglu
Copy link
Member

LGTM 👍

@devrimcavusoglu devrimcavusoglu merged commit 4a8dec2 into obss:main Feb 11, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

BLEU metric calculates wrong results for single hypothesis single reference pairs.
2 participants