2.7.27

2.7.27 (2026-02-11)

Documentation

• docs: Outline for adding a task documentation (#4082)

• docs: Outline for adding a task documentation

This is a suggested structure, PR is just to get feedback before I finish it up.

fixes #4077

• upd docs

• install dependencies in ci

• add example with retrieval

• filled out the missing segments

• lint and format

• Apply suggestions from code review

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

• fix numerating and indent

• add missing imports

• fix links

• add full example for retrieval dataset

---

Co-authored-by: Roman Solomatin <36135455+Samoed@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> (42b8058)

• docs: Improve docstring for some of the main abstasks (#4083)

• docs: fix AbsTaskClassification docstring formatting and improve docstrings for some of the main tasks

• format (50bd0fa)

Fix

• fix: Add performance per language tab to more benchmarks (#4066)

Add Performance per language Tab to more benchmarks (4ca1922)

Unknown

• dataset: add 'law-ir_ko' dataset for IR task (#4052)

• law_ir_ko

• Update mteb/tasks/retrieval/kor/law_ir_ko.py

Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>

• law_ir_ko info revision

• description

• metadata-info rev

• metadata-info rev

• Update mteb/tasks/retrieval/kor/law_ir_ko.py

Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>

• statistics(), reference

• format citation

• author & howpublished rev

• make lint

• description rev

• Update mteb/tasks/retrieval/kor/law_ir_ko.py

Co-authored-by: Kenneth Enevoldsen <kenevoldsen@pm.me>

• Update mteb/tasks/retrieval/kor/law_ir_ko.py

---

Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>
Co-authored-by: Roman Solomatin <36135455+Samoed@users.noreply.github.com>
Co-authored-by: Kenneth Enevoldsen <kenevoldsen@pm.me> (1cdc662)

• model: Add ModelMeta for geoffsee/auto-g-embed-st (#4074)

Add ModelMeta for geoffsee/auto-g-embed-st (81540a2)

• Add MetaCLIP 2 model integration (#4065)

• Add MetaCLIP 2 model integration

Add support for facebook/metaclip-2-mt5-worldwide-b32, a multilingual
vision-language model using mT5 tokenizer for worldwide language support.

• 254M parameters, 512 embedding dimension
• Supports 99 languages (XLMR language set)
• Handles MetaCLIP 2's BaseModelOutputWithPooling return format

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

• Add n_embedding_parameters for MetaCLIP 2 model

Set n_embedding_parameters to 128,057,344 (mT5 vocab size 250,112 × embed_dim 512)
to fix test_n_embedding_parameters test failure.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

• Add training metadata for MetaCLIP 2 model

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

• Apply suggestion from @Samoed

Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>

---

Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: Roman Solomatin <samoed.roman@gmail.com> (4280dd9)