2.20.4

2.20.4 (2026-08-29)

Fix

• fix: mock_tasks not supported by get_instruction (#5298)

• fix mock_tasks not supported by get_instruction

• fix typecheck

• fixing to get prompt from base class

• added prompts for zero-shot classification and Image-Text Pair classification in

• remove code from get_tasks (b36fc25)

Unknown

• fix image dataloader (#5309)

• fix image loader

• rename

• fix typing (d384f76)

• Update SugarCrepe task description to reflect word order (#5314)

SugarCrepe: note that 572/7511 pairs differ only in word order

Counted on mteb/SUGARCREPE_fmt: 572 of 7511 pairs have a caption and
negative_caption that are the same multiset of words, all from the
swap_obj and swap_att subsets. An order-insensitive text representation
scores chance on those by construction, capping text_acc at 0.962. (1c9514d)