Skip to content

Issues: embeddings-benchmark/mteb

Merge v2.0.0: Overview issue
#1791 opened Jan 13, 2025 by KennethEnevoldsen
Open 2
Overview: Leaderboard release
#1867 opened Jan 24, 2025 by x-tabdeveloping
Open 26
MAEB Overview Issue
#2072 opened Feb 16, 2025 by isaac-chung
Open 6
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

239 Open 664 Closed
239 Open 664 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

raise_on_error = False does not prevent all errors
#2345 opened Mar 13, 2025 by KennethEnevoldsen
Integrate Multicultural Vision-Language Dataset for Southeast Asia mieb The image extension of MTEB new dataset Issues related to adding a new task or dataset
#2343 opened Mar 13, 2025 by Samoed
Add AudioFlamingo2 Model and datasets maeb Audio extension
#2336 opened Mar 12, 2025 by RahulSChand
@RahulSChand @silky1708 @anime-sh
Reduce logging in the leaderboard good first issue Good for newcomers leaderboard issues related to the leaderboard
#2333 opened Mar 11, 2025 by KennethEnevoldsen
3
Add All DCASE tasks across years maeb Audio extension
#2332 opened Mar 11, 2025 by RahulSChand
@RahulSChand @silky1708 @anime-sh
Error while evaluating on BrightRetrieval bug Something isn't working
#2327 opened Mar 11, 2025 by aladeen57
1
3
Add dataset on bioacoustics maeb Audio extension
#2321 opened Mar 11, 2025 by KennethEnevoldsen
Add all datasets used in the clap paper maeb Audio extension
#2319 opened Mar 11, 2025 by RahulSChand
@RahulSChand @silky1708 @anime-sh
Add MelGAN maeb Audio extension new model Questions related to adding a new model to the benchmark
#2318 opened Mar 11, 2025 by mina-parham
@mina-parham
Add WaveRNN maeb Audio extension new model Questions related to adding a new model to the benchmark
#2317 opened Mar 11, 2025 by mina-parham
@mina-parham
Add COLA maeb Audio extension new model Questions related to adding a new model to the benchmark
#2316 opened Mar 11, 2025 by mina-parham
@mina-parham
Add WaveGAN maeb Audio extension new model Questions related to adding a new model to the benchmark
#2315 opened Mar 11, 2025 by mina-parham
@mina-parham
Add HiFi-GAN maeb Audio extension new model Questions related to adding a new model to the benchmark
#2314 opened Mar 11, 2025 by mina-parham
@mina-parham
Add VocalSound maeb Audio extension new dataset Issues related to adding a new task or dataset
#2313 opened Mar 11, 2025 by mina-parham
@mina-parham
Add FSDKaggle2018 maeb Audio extension new dataset Issues related to adding a new task or dataset
#2312 opened Mar 11, 2025 by mina-parham
@mina-parham
Add LibriSpeech maeb Audio extension new dataset Issues related to adding a new task or dataset
#2311 opened Mar 11, 2025 by mina-parham
@mina-parham
Add RAVDESS maeb Audio extension new dataset Issues related to adding a new task or dataset
#2310 opened Mar 11, 2025 by mina-parham
@mina-parham
Add VGG-Sound maeb Audio extension new dataset Issues related to adding a new task or dataset
#2309 opened Mar 11, 2025 by mina-parham
@mina-parham
Integrate Multimodal BEIR mieb The image extension of MTEB
#2308 opened Mar 10, 2025 by Samoed
Integrate siglip2 mieb The image extension of MTEB new model Questions related to adding a new model to the benchmark
#2301 opened Mar 9, 2025 by Samoed
Remove comments from Makefile
#2300 opened Mar 9, 2025 by Samoed
7
[v2] Move wrappers to folder v2 Issues and PRs related to `v2` branch
#2299 opened Mar 9, 2025 by Samoed v2.0.0
4
Add SpeechCOCO and Flickr8k datasets for Any2AnyRetrieval maeb Audio extension new dataset Issues related to adding a new task or dataset
#2298 opened Mar 9, 2025 by kkaitlyn111
1
Create audio reranking AbsTask and Evaluator maeb Audio extension new dataset Issues related to adding a new task or dataset
#2297 opened Mar 9, 2025 by kkaitlyn111
@switchpiggy
Create AnyClassification Abstask and Evaluator maeb Audio extension new dataset Issues related to adding a new task or dataset
#2296 opened Mar 9, 2025 by kkaitlyn111
4
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.