Skip to content

2.1.18

Choose a tag to compare

@KennethEnevoldsen KennethEnevoldsen released this 24 Nov 14:29
· 1271 commits to main since this release

2.1.18 (2025-11-24)

Fix

  • fix: Correcting the cohere lstrip bug in cohere (#3610)

  • Correcting the cohere lstrip bug

  • Update mteb/models/model_implementations/cohere_models.py

Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>


Co-authored-by: Roman Solomatin <samoed.roman@gmail.com> (398b31b)

Unknown

  • add note for BUCC tasks about using train split (#3609)

add note for BUCC tasks about using train split; (3af54eb)

  • add missing citation for Vietnamese retrieval datasets (#3608)

  • add missing citation

  • Update mteb/tasks/retrieval/vie/green_node_table_markdown_retrieval.py

Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>

  • remove editors for now

Co-authored-by: Roman Solomatin <samoed.roman@gmail.com> (027bc17)

  • tests: Add tests for dataset quality (#3603)

  • tests: Add test to prevent low-quality tasks

This tests ensures a minimum quality of task for future submissions

Currently it tests for:

  • text duplicates
  • train test leakage
  • too short documents

I suspect we can likely add many more tests to this in future PRs

  • collect all errors before raising

  • Update tests/test_tasks/test_task_quality.py

Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>


Co-authored-by: Roman Solomatin <samoed.roman@gmail.com> (9b898ea)

  • model: Add model2vecdk models (#3600)

  • model: Add model2vecdk models

  • Apply suggestions from code review (300418d)

  • model: Remove flash_attn for Tarka (#3599) (7f4bcbb)