2.1.17 (2025-11-20)

Fix

fix: improve messages for running missing splits (#3596)

It now looks like:

INFO:mteb.evaluate:Found existing results for MassiveIntentClassification, only running missing splits (subset): {&#39;validation&#39;: [&#39;hy&#39;, &#39;jv&#39;, &#39;fr&#39;, &#39;hu&#39;, &#39;tl&#39;, &#39;az&#39;, &#39;zh-CN&#39;, &#39;ms&#39;, &#39;ar&#39;, &#39;pt&#39;, &#39;ja&#39;, &#39;tr&#39;, &#39;hi&#39;, &#39;lv&#39;, &#39;sw&#39;, &#39;nl&#39;, &#39;en&#39;, &#39;ko&#39;, &#39;mn&#39;, &#39;zh-TW&#39;, &#39;kn&#39;, &#39;am&#39;, &#39;he&#39;, &#39;my&#39;, &#39;sq&#39;, &#39;vi&#39;, &#39;fi&#39;, &#39;ru&#39;, &#39;cy&#39;, &#39;it&#39;, &#39;pl&#39;, &#39;el&#39;, &#39;de&#39;, &#39;te&#39;, &#39;af&#39;, &#39;ro&#39;, &#39;sl&#39;, &#39;fa&#39;, &#39;ur&#39;, &#39;ml&#39;, &#39;is&#39;, &#39;bn&#39;, &#39;es&#39;, &#39;km&#39;, &#39;ka&#39;, &#39;th&#39;, &#39;ta&#39;, &#39;id&#39;], &#39;test&#39;: [&#39;hy&#39;, &#39;jv&#39;, &#39;fr&#39;, &#39;hu&#39;, &#39;tl&#39;, &#39;az&#39;, &#39;zh-CN&#39;, &#39;ms&#39;, &#39;ar&#39;, &#39;pt&#39;, &#39;ja&#39;, &#39;tr&#39;, &#39;hi&#39;, &#39;lv&#39;, &#39;sw&#39;, &#39;nl&#39;, &#39;en&#39;, &#39;ko&#39;, &#39;mn&#39;, &#39;zh-TW&#39;, &#39;kn&#39;, &#39;am&#39;, &#39;he&#39;, &#39;my&#39;, &#39;sq&#39;, &#39;vi&#39;, &#39;fi&#39;, &#39;ru&#39;, &#39;cy&#39;, &#39;it&#39;, &#39;pl&#39;, &#39;el&#39;, &#39;de&#39;, &#39;te&#39;, &#39;af&#39;, &#39;ro&#39;, &#39;sl&#39;, &#39;fa&#39;, &#39;ur&#39;, &#39;ml&#39;, &#39;is&#39;, &#39;bn&#39;, &#39;es&#39;, &#39;km&#39;, &#39;ka&#39;, &#39;th&#39;, &#39;ta&#39;, &#39;id&#39;]}
``` ([`5d7b78b`](https://github.com/embeddings-benchmark/mteb/commit/5d7b78bd84437f14f01149d86e362b1016d4e88f))

Navigation Menu

2.1.17

Choose a tag to compare

Sorry, something went wrong.

Sorry, something went wrong.

Uh oh!

No results found

2.1.17 (2025-11-20)

Fix

Uh oh!