2.3.8

2.3.8 (2025-12-08)

Fix

• fix: Add hamming score to multilabel classification (#3700)

• test: add mixed performance case for hamming_score

• add hamming score to multilabel classification metrics

🤖 Generated with Claude Code

Co-Authored-By: Claude Sonnet 4 <noreply@anthropic.com>

• move to eval folder

• remove try except

---

Co-authored-by: Claude Sonnet 4 <noreply@anthropic.com> (bc2e24e)

Unknown

• dataset: Replace JMTEB(v2) with MTEB(jpn,v1) for general-purpose Japanese evaluation (#3699)

• Replace JMTEB(v2) with MTEB(jpn,v1) for general-purpose Japanese evaluation

• fix get_benchmark as Japanese benchmark updated

• Replace MTEB(jpn, v1) with JMTEB(v2)

• Revert "Replace MTEB(jpn, v1) with JMTEB(v2)"

This reverts commit b49f67b.

• keep MTEB(jpn, v1) as legacy

• revert class name

• revert change (11a2e9e)

• dataset: RuSciBenchBitextMining small dataset cleanup (#3690)

• RuSciBenchBitextMining small dataset cleanup

• RuSciBenchBitextMining new version

• Add RuSciBenchBitextMining.v2 stats (cb4b3ed)

• model: add NbAiLab/nb-bert-large and NbAiLab/nb-bert-base (#3688)

• Initial plan

• Add NbAiLab/nb-bert-large model to MTEB

Co-authored-by: KennethEnevoldsen <23721977+KennethEnevoldsen@users.noreply.github.com>

• Apply suggestions from code review

• add models

• fix naming and linting

---

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: KennethEnevoldsen <23721977+KennethEnevoldsen@users.noreply.github.com>
Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsen@gmail.com> (97834cb)

• Add dataset task filter (#3685)

• init task filter

• fix typehint

• split filters and pipelines

• change filters logging (3afd6f8)