Skip to content

2.14.6

Choose a tag to compare

View all tags
@KennethEnevoldsen KennethEnevoldsen released this 08 Jun 12:09
· 491 commits to main since this release
2.14.6
033b2e3

2.14.6 (2026-06-08)

Fix

  • fix: PC multimodal support (#4645)

  • fix PC multimodal

  • fix modality get

  • fix tasks

  • fix category

  • fix multimodal pair tasks

  • typecheck

  • fix typing

  • upd docs

  • change to mapping

  • change to mapping (a0e219c)

Unknown

  • benchmarks: add MVEB benchmark suite + leaderboard Video menu (#4763)

  • benchmarks: add MVEB benchmark suite + leaderboard Video menu

Adds the MVEB (Massive Video Embedding Benchmark) benchmark objects to
main so the leaderboard and get_benchmark() can resolve them. The
underlying tasks are already on main; this adds only the curated
benchmark groupings and their registration.

  • benchmarks.py: MVEB (23 tasks), MVEB(text, video) (19), MVEB(video)
    (9), MVEB(beta, extended) (184, alias MVEB(extended)).
  • benchmarks/init.py: import + all registration.
  • _leaderboard_menu.py: new "Video" group under General Purpose.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

  • benchmarks: mark MVEB suite beta; drop extended from leaderboard menu

Addresses review:

  • Rename to beta variants: MVEB(beta), MVEB(video, beta),
    MVEB(text, video, beta) (consistent with MAEB/RTEB). Old names kept
    as aliases so get_benchmark("MVEB") etc. still resolve.
  • Leaderboard "Video" menu no longer displays MVEB(beta, extended).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

  • fix docs

Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Roman Solomatin <36135455+Samoed@users.noreply.github.com> (b5e03a4)

Assets 6
Loading