Skip to content

1.37.0

Choose a tag to compare

@KennethEnevoldsen KennethEnevoldsen released this 16 Apr 12:17
· 1869 commits to main since this release

1.37.0 (2025-04-16)

Feature

  • feat: Added dataframe utilities to BenchmarkResults (#2542)

  • fix: Added dataframe utilities to BenchmarkResults

  • Added get_results_table. I was considering renaming it to to_dataframe to align with tasks.to_dataframe. WDYT?
  • Added a tests for ModelResults and BenchmarksResults
  • Added a few utility functions where needed
  • Added docstring throughout ModelResults and BenchmarksResults
  • Added todo comment for missing aspects - mostly v2 - but we join_revisions seems like it could use an update before then.

Prerequisite for #2454:

@ayush1298 can I ask you to review this PR as well? I hope this give an idea of what I was hinting at. Sorry that it took a while. I wanted to make sure to get it right.

  • refactor to to_dataframe and combine common dependencies

  • ibid

  • fix revision joining after discussion with @x-tabdeveloping

  • remove strict=True for zip() as it is a >3.9 feature

  • updated mock cache (8fe5742)

Unknown

  • fix me5 trainind data config to include xquad dataset (#2552)

  • fix: me5 trainind data config to include xquad dataset

  • Update mteb/models/e5_models.py

upddate: xquad key name

Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>

  • fix: ME5_TRAINING_DATA format

Co-authored-by: Roman Solomatin <samoed.roman@gmail.com> (1f82b59)

  • Add xlm_roberta_ua_distilled (#2547)

  • defined model metadata for xlm_roberta_ua_distilled

  • Update mteb/models/ua_sentence_models.py

Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>

  • included ua_sentence_models.py in overview.py

  • applied linting, added missing fields in ModelMeta

  • applied linting


Co-authored-by: Roman Solomatin <samoed.roman@gmail.com> (3ff993d)

  • Docs: Add MIEB to README (#2550)

Add MIEB to README (75d3597)