Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Odia translation test suite #162

Closed
GautamR-Samagra opened this issue Jun 25, 2023 · 0 comments
Closed

Odia translation test suite #162

GautamR-Samagra opened this issue Jun 25, 2023 · 0 comments
Assignees

Comments

@GautamR-Samagra
Copy link
Collaborator

Description:

This is to maintain a test suite of Odia translations. The test suite will consist of Odia sentences paired with their correct translations, serving as a reliable benchmark to evaluate the accuracy of translation models. In addition, a metric based on BLEU score will be developed to quickly assess the accuracy of translations.

Tasks:

  • Compile a comprehensive test suite of Odia sentences for agri domain: Create a collection of diverse Odia sentences covering multiple possible agri-related topics that can used as a test suite for any change in translation model.

  • Gather accurate translations: Pair each Odia sentence from the test suite with its correct English translation. Collaborate with Odia PT team to verify translations.

  • Develop a metric to measure translation accuracy: Establish a metric to measure the accuracy of translations - BLEU score.

ETA:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants