2.18.11

2.18.11 (2026-07-30)

Fix

• fix: Add MockTask for testing new model implementations (#4814)

• Add MockTask for testing new model implementations

• fix import in test file

• Added under mteb package and remove from tests

• restore unnecessary changes

• fix lintter

• remove from init.py

• move mocktasks under mteb/tests_mock

• fix imports

• added mteb.tests_mock to not typecheck in ptproject.toml

• rename folder and move files

• remove mock_tasks.py and add separate file under mteb/tests/mock_task folder

• remove unnecessary files and simplify

• fix test and make removed legacy MockTask exposing to public

• remove TYPE_CHECKING import

• remove unncessary rules added to lintter for mteb/tests

• rename folder from mteb/tests to mteb/mocks

• remove tests/mock_tasks.py and update imports in tests

• remove mteb/mocks/task_grid.py and add all things to mteb/mocks/init.py

• removed utils.py and add create_mock_samples.py

• change MockFastClusteringTask to LegacyMockFastClusteringTask and move multilingual_eval_langs to individual files

• added mock-run CLI command for Mocktasks verification

• fix MockRetrieval task import in test_hybrid_search.py

• minor markdown formatting fix

• update table format

• add reason column

• fix typecheck error

• update formatting of terminal output as per review

• changes from review

• Separate core functionality to separate script and simplify CLI command, other docs changes frm reviws

• rename function to match CLI and other changes from review

• added MockRunResults and simplified other things

• small fix

• fix import

• lintter

• minor fixed in mock_task

• minor error fix

• minor

• lintter (f5337a7)

Unknown

• fix low dependency (#5053) (bdce12d)