2.5.5

2.5.5 (2025-12-30)

Documentation

• docs: add benchmark filtering examples (#3805)

• docs: add benchmark filtering examples

• Apply suggestion from @Samoed

Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>

• docs: remove custom benchmarks subsection

• docs: expand filtering section with content tabs

• docs: fix code block indentation in content tabs

• build: include docs deps in dev group

---

Co-authored-by: Roman Solomatin <samoed.roman@gmail.com> (b1aae79)

Fix

• fix: repo exists check (#3813)

• fix repo exists check

• add test (6ebc5fd)

Unknown

• Update the API of Bytedance/Seed1.6-embedding-1215 (#3814)

• update reference website of Seed1.6-embedding-1215

• update Bytedance/Seed1.6-embedding-1215 model (ab2d494)

• update generate_model_card with get_benchmark_result() (#3796)

• update generate_model_card with get_benchmark_result()

• add support for list of benchmarks

• split parameters

• fix type

• generate card

• add tests

• add tests

• add tabulate to test dependencies

• correct tests

---

Co-authored-by: Roman Solomatin <36135455+Samoed@users.noreply.github.com> (9e867f5)

• Add function for creating mock images (#3803)

• create function for creating mock tasks

• add annotations (48f137e)

• Add benchmark aliases (#3767)

• add benchmark aliases

• split to aliases

• move aliases

• create aliases in separate function

• simplify a bit

• add test

• Apply suggestions from code review

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsen@gmail.com>

• add default value

• add MTEB alias

---

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsen@gmail.com> (480f1b9)