Repository navigation
1.37.0
1.37.0 (2025-04-16)
Feature
-
feat: Added dataframe utilities to BenchmarkResults (#2542)
-
fix: Added dataframe utilities to BenchmarkResults
- Added
get_results_table. I was considering renaming it toto_dataframeto align withtasks.to_dataframe. WDYT? - Added a tests for ModelResults and BenchmarksResults
- Added a few utility functions where needed
- Added docstring throughout ModelResults and BenchmarksResults
- Added todo comment for missing aspects - mostly v2 - but we join_revisions seems like it could use an update before then.
Prerequisite for #2454:
@ayush1298 can I ask you to review this PR as well? I hope this give an idea of what I was hinting at. Sorry that it took a while. I wanted to make sure to get it right.
-
refactor to to_dataframe and combine common dependencies
-
ibid
-
fix revision joining after discussion with @x-tabdeveloping
-
remove strict=True for zip() as it is a >3.9 feature
-
updated mock cache (
8fe5742)
Unknown
-
fix me5 trainind data config to include xquad dataset (#2552)
-
fix: me5 trainind data config to include xquad dataset
-
Update mteb/models/e5_models.py
upddate: xquad key name
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>
- fix: ME5_TRAINING_DATA format
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com> (1f82b59)
-
Add xlm_roberta_ua_distilled (#2547)
-
defined model metadata for xlm_roberta_ua_distilled
-
Update mteb/models/ua_sentence_models.py
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>
-
included ua_sentence_models.py in overview.py
-
applied linting, added missing fields in ModelMeta
-
applied linting
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com> (3ff993d)
- Docs: Add MIEB to README (#2550)
Add MIEB to README (75d3597)