Skip to content

Multimodal Matryoshka, Multimodal DPO, and ONNX πŸŽ‰

Compare
Choose a tag to compare
@ashvardanian ashvardanian released this 28 Mar 20:35
· 77 commits to main since this release

DPO Preview

Today we are releasing a new batch of multimodal models trained with Nebius and already available on HuggingFace πŸ€—

  1. Matryoshka style multimodal embeddings ranging from 64 to 256 and 768 dimensions πŸ–ΌοΈ
  2. Improved multimodal chat in 1.2B parameters, tuned with Direct Preference Optimization πŸ’¬
  3. ONNX backend, making PyTorch dependency optional for lightning fast deployments ⚑