Repository navigation
2.1.18
2.1.18 (2025-11-24)
Fix
-
fix: Correcting the cohere lstrip bug in
cohere(#3610) -
Correcting the cohere lstrip bug
-
Update mteb/models/model_implementations/cohere_models.py
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com> (398b31b)
Unknown
- add note for BUCC tasks about using train split (#3609)
add note for BUCC tasks about using train split; (3af54eb)
-
add missing citation for Vietnamese retrieval datasets (#3608)
-
add missing citation
-
Update mteb/tasks/retrieval/vie/green_node_table_markdown_retrieval.py
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>
- remove editors for now
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com> (027bc17)
-
tests: Add tests for dataset quality (#3603)
-
tests: Add test to prevent low-quality tasks
This tests ensures a minimum quality of task for future submissions
Currently it tests for:
- text duplicates
- train test leakage
- too short documents
I suspect we can likely add many more tests to this in future PRs
-
collect all errors before raising
-
Update tests/test_tasks/test_task_quality.py
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com> (9b898ea)