Implementing Flores 200 translation evaluation benchmark across 200 languages #1706
Commits on Mar 8, 2024
Commits on Mar 11, 2024
-
Merge pull request #1 from sambanova/zoltanc/sib200
implement sib200
Commits on Mar 13, 2024
Commits on Mar 14, 2024
-
-
-
-
Merge pull request #2 from sambanova/zoltanc/exams
Implement exams dataset
-
Merge pull request #3 from sambanova/zoltanc/flores200
implement flores evaluation
Commits on Mar 18, 2024
-
-
Merge pull request #4 from sambanova/zoltanc/move_sib200
move sib200 files into lm_eval/tasks/sib200
Commits on Mar 19, 2024
-
-
Merge pull request #5 from sambanova/zoltanc/exams_generate_configs
small fix in repeated for loop
Commits on Mar 21, 2024
-
Merge pull request #6 from sambanova/zoltanc/exams_template
Closed Book Exams Choices template fix
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.