Skip to content

1.39.2

Choose a tag to compare

@KennethEnevoldsen KennethEnevoldsen released this 02 Oct 17:23
· 1408 commits to main since this release

1.39.2 (2025-10-02)

Documentation

  • docs: Update adding benchmark documentation (#3229)

  • update adding_a_benchmark.md documentation

  • fix numbers (50aa4ac)

Fix

  • fix: Further specified macro-language code for Norwegian (#3228)

  • fix: Further specified macro-language code for Norwegian

"nor" is a macro-language code that covers bokmål and nynorsk (both norwegian), but this means that these datasets will be missed if using "nob" or "nno". Specifying it like this should allow this.

  • furhter specified macro language "nor" (a2f7488)

Unknown

  • Update tasks & benchmarks tables (810ae28)

  • Remove 'HUME(v1)' from leaderboard benchmark (#3236)

  • Remove 'HUME(v1)' from leaderboard benchmark

  • lint (e419b54)

  • Update tasks & benchmarks tables (9a606a0)

  • dataset: add human tasks and benchmark (#3214)

  • Human Subsets Tasks

  • Fixed Multilingual Classification Subset

  • linting

  • fix citations format

  • make lint

  • fix tests

  • remove human folder

  • fix relative imports

  • add adapted_from for all human subsets

  • fix pydantic errors

  • add benchmark object

  • make benchmark discoverable

  • bibtex test

  • Apply suggestion

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsen@gmail.com>

  • Apply suggestions from code review

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsen@gmail.com>

  • rename & reupload

  • upd tests

  • upd tests again

  • add model

  • add benchmark to leaderboard

  • change branch of leaderboard

  • remove branch of load data

  • fix model meta path

  • make mteb importable

  • update repo

  • Update mteb/benchmarks/benchmarks/benchmarks.py

  • Update mteb/leaderboard/benchmark_selector.py

  • Update mteb/load_results/load_results.py

Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>


Co-authored-by: Adnan El Assadi <aassadi22@ku.edu.tr>
Co-authored-by: Isaac Chung <chungisaac1217@gmail.com>
Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsen@gmail.com>
Co-authored-by: AdnanElAssadi56 <115242814+AdnanElAssadi56@users.noreply.github.com> (48a01fc)