Skip to content

2.10.9

Choose a tag to compare

View all tags
@KennethEnevoldsen KennethEnevoldsen released this 10 Mar 11:00
· 911 commits to main since this release
2.10.9
482930f

2.10.9 (2026-03-10)

Documentation

  • docs: migrate to zensical (#4203)

  • migrate to zeniscal

  • added breadcrumbs

  • added navigation icons

  • minor docs fix

  • fix annotations

  • change to links

  • fixed overview for models and benchmarks

  • try to use zensical

Conflicts:

docs/overview/create_available_benchmarks.py

docs/overview/create_available_models.py

  • add copy paste button for models

  • add copy-paste button to tasks and benchmarks as well

  • remove plugins

  • get back mieb and mmteb

  • rename api back

  • add tasks to overview

  • reorder overview page

  • update lock file

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsen@gmail.com> (a484cfd)

Fix

  • fix: Display main score in task results (#4214)

Now diplay main score in task results. As well as the task_res.main_score property.

Also added "..." to indicate that there are more attributed than what is being shown.

res = mteb.evaluate(model, task)
res
res[0]
# currently displays:
# ModelResult(model_name=mteb/baseline-random-encoder, model_revision=1, task_results=[...](#1))
# TaskResult(task_name=LccSentimentClassification, scores=...)

# with PR:
# ModelResult(model_name=mteb/baseline-random-encoder, model_revision=1, task_results=[...](#1), ...)
# TaskResult(task_name=LccSentimentClassification, main_score=0.32, scores=...)
``` ([`7c831b0`](https://github.com/embeddings-benchmark/mteb/commit/7c831b068b0e8341485b745e05803239a5d16c2f))

## Unknown

* model: Qwen3-VL-Embedding (#4198)

* add qwen3-vl-embedding implementation

* lint and test

* lint

* handle image+text mode

* address review comments

* address comments

* fix resolve dependency

---------

Co-authored-by: Kenneth Enevoldsen &lt;kennethcenevoldsen@gmail.com&gt; ([`0bb0917`](https://github.com/embeddings-benchmark/mteb/commit/0bb0917c596247b1fa336a73cbbc71b3a1ac01f9))

* Added model zeroentropy/zembed-1 (#4202)

* Added model zeroentropy/zembed-1

- [y] I have filled out the ModelMeta object to the extent possible
- [y] I have ensured that my model can be loaded using
  - [y] `mteb.get_model(model_name, revision)` and
  - [y] `mteb.get_model_meta(model_name, revision)`
- [y] I have tested the implementation works on a representative set of tasks.
- [y] The model is public, i.e., is available either as an API or the weights are publicly available to download

* Apply suggestion from @Samoed

Co-authored-by: Roman Solomatin &lt;samoed.roman@gmail.com&gt;

* lint

---------

Co-authored-by: Ryan Wang &lt;ryanwang@DN0a249162.SUNet&gt;
Co-authored-by: Roman Solomatin &lt;samoed.roman@gmail.com&gt;
Co-authored-by: Roman Solomatin &lt;36135455+Samoed@users.noreply.github.com&gt; ([`69421f9`](https://github.com/embeddings-benchmark/mteb/commit/69421f95fafb55e7f183b89544a31fed4e56fa18))

* Add Reason-ModernColBERT (#4218)

* Add Reason-ModernColBERT

* Fix variable name + add size

* Fix variable name + add size ([`b877424`](https://github.com/embeddings-benchmark/mteb/commit/b8774246a712cc5c9878a8abc022d1e155158708))
Assets 6
Loading