1.38.22

1.38.22 (2025-06-02)

Documentation

• docs: Updated description of FEVER (#2745)

• docs: Updated description of FEVER

Update the description to state that the corpus is the same as fever as we have have multiple questions on it

• minor (82f0bb9)

Fix

• fix: Update caltech101 (#2759)

• docs: Updated description of FEVER

Update the description to state that the corpus is the same as fever as we have have multiple questions on it

• fix: Update Caltech101 to different source

Run both versions of one of the task using nomic-ai/nomic-embed-text-v1.5 and both scores match:

Old

{
  "dataset_revision": "851374102055782c84f89b1b4e9d128a6568847b",
  "task_name": "Caltech101",
  "mteb_version": "1.38.4",
  "scores": {
    "test": [
      {
        "accuracy": 0.897863,

New

{
  "dataset_revision": "52439cf6d4f6ebf563d8cdc7f2c5371d9efd2686",
  "task_name": "Caltech101",
  "mteb_version": "1.38.4",
  "scores": {
    "test": [
      {
        "accuracy": 0.897929,
``` ([`1651f60`](https://github.com/embeddings-benchmark/mteb/commit/1651f60afeed767eba0fd0aae895108080301fee))

## Unknown

* Update Seed1.5 training data (#2749)

* update seed1.5 training data

* update seed1.5 training data ([`ccc5714`](https://github.com/embeddings-benchmark/mteb/commit/ccc5714938c690998a3c3e5807f55436e3e29af5))

* Update tasks & benchmarks tables ([`fe6729f`](https://github.com/embeddings-benchmark/mteb/commit/fe6729ff4ebbbe4373a984ab9dadbdf7df5a4f2c))

* Backfill task metadata for metadata for BigPatentClustering and AllegroReviews (#2755)

* big-patent

* allegro-reviews ([`e151fbd`](https://github.com/embeddings-benchmark/mteb/commit/e151fbd7920e5778a16c0cbeefcfb239362935e2))