fusion-embedding-1-2b-preview v0.2
fusion-embedding-1-2b-preview v0.2
Second preview checkpoint, trained on a 484K-pair corpus (3.7× v0.1): the full AudioCaps train split, FSD50K, WavCaps/AudioSet_SL, and a 318K-clip LAION-FreeSound subset, with 10-second training windows. Architecture and inference API are unchanged from v0.1; existing integrations work as-is.
Model weights and model card: https://huggingface.co/EximiusLabs/fusion-embedding-1-2b-preview (v0.1 remains available as a pinned revision)
v0.1 → v0.2
| Benchmark | v0.1 | v0.2 |
|---|---|---|
| AudioCaps test A→T R@1 / R@10 | 0.216 / 0.626 | 0.279 / 0.717 |
| AudioCaps test T→A R@10 | 0.680 | 0.736 |
| Clotho v2.1 zero-shot A→T / T→A R@10 | 0.252 / 0.329 | 0.448 / 0.449 |
| VGGSound audio↔image R@10 (emergent, centered readout) | 0.368 / 0.388 | 0.418 / 0.440 |
| VGGSound audio↔text R@10 | 0.555 / 0.592 | 0.588 / 0.631 |
All evaluations use the same protocols as v0.1 (AudioCaps 5-reference min-rank; Clotho excluded from training; VGGSound-AV 696 pairs with no audio-visual training pairs). Reference points: fully fine-tuned CLAP-family models reach AudioCaps A→T R@10 0.906–0.928; zero-shot WavCaps-CLAP reaches Clotho A→T R@10 0.576.
Training changes in this repository at this tag
- Corpus ingestion for AudioCaps train and LAION-FreeSound WebDataset tars (resumable, blacklisted against all evaluation sets)
- 10-second random-crop training windows for long-form audio
- Full-corpus negative bank scaled to 484K entries
License
Preview weights: CC-BY-NC-4.0 (research; see the model card for training-data provenance).