Generation 2, third release: two revisions from the v0.3 training line.
v0.3 ships two checkpoints under one repository. The default (v0.3-preview) is retrieval-tuned; a keyword-tuned revision (v0.3-kw-preview) is available for spoken-command use. Non-audio outputs remain bit-for-bit the base model's, verified on the shipped artifacts before push.
Highlights (v0.3-preview, the default)
- AudioCaps audio-to-text R@10 0.743 -> 0.785 over v0.2 (R@1 0.310 -> 0.333); text-to-audio R@10 0.782.
- MAEB(audio-only) 19-task mean 0.454; leads the board on IEMOCAP speaker-gender classification (0.938).
- Emotion recognition regressed: RAVDESS zero-shot 0.35 -> 0.21. The v0.3 mix improved spoken-content understanding at the cost of vocal-prosody sensitivity; evaluate before adopting if speech-emotion is central.
v0.3-kw-preview (keyword-tuned)
- SpeechCommands zero-shot 0.133 -> 0.929. AudioCaps a2t R@10 0.749, lower than the default's 0.785; use the default for general audio-text retrieval and this revision only when spoken-command matching is the priority.
Weights and model card: https://huggingface.co/EximiusLabs/fusion-embedding-2-2b-preview (revision v0.3-preview is the default; v0.3-kw-preview for the keyword variant; v0.1-preview and v0.2-preview remain pinned for reproducibility). Technical report: https://arxiv.org/abs/2607.18666