2.7.23
2.7.23 (2026-02-04)
Fix
-
fix: Fill in embedding and total parameters in ModelMeta (#4031)
-
Filling Embedding/Total Parameters in ModelMeta
-
Add parameter for other models
-
Add parameters for more models
-
Added exact value for n_parameters
-
Fix tests
-
set n_embedding_parameters to None
-
Add results of some more models
-
Add tests
-
Add _HISTORIC_MODELS list in test
-
Update tests/test_models/test_model_meta.py
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>
-
fix tests
-
correct tests
-
fix _HISTORIC_MODELS list
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com> (bc6e6cb)
Unknown
-
dataset: Add ERESS reranking task (#3991)
-
dataset: Add ERESS reranking task
- Add ERESSReranking task for e-commerce product relevance reranking
- Dataset: thebajajra/eress with ~72k query-product pairs
- Supports graded relevance (0-100 integer scale)
- Main metric: nDCG@5
- Add E-commerce domain and Product Reranking subtypes to TaskMetadata
- Include descriptive statistics
-
fix: align dataset_transform signature with base class
-
fix: dataset reuploaded, custom transformation removed
-
fix: rev updated with title + text combination
-
description moved away from docstring
-
Update mteb/tasks/reranking/eng/ecommerce_product_relevance_reranking.py
Co-authored-by: Kenneth Enevoldsen <kenevoldsen@pm.me> (fe67f8e)