EuroMoE-2.6B-A0.6B

This repository hosts the paper for the EuroMoE-2.6B-A0.6B models.

Paper

• EuroMoE-2.6B-A0.6B report (PDF)

Models

• Instruct: utter-project/EuroMoE-2.6B-A0.6B-Instruct-2512
• Base: utter-project/EuroMoE-2.6B-A0.6B-2512

General Information

• Developed by: Instituto Superior Técnico - University of Lisbon, Instituto de Telecomunicações, Unbabel, University of Paris-Saclay, Artefact Research Center.
• Authors: Duarte M. Alves; Miguel Moura Ramos; Hippolyte Gisserot-Boukhlef; João Alves; Pedro Henrique Martins; Patrick Fernandes; José Pombal; Nuno M. Guerreiro; Ricardo Rei; Amin Farajian; José G. C. de Souza; Pierre Colombo; André F. T. Martins.
• Funded by: European Union.
• Model type: A 2.6B parameter multilingual transformer MoE with 0.6B active parameters.
• Language(s) (NLP): Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish, French, German, Greek, Hungarian, Irish, Italian, Latvian, Lithuanian, Maltese, Polish, Portuguese, Romanian, Slovak, Slovenian, Spanish, Swedish, Arabic, Catalan, Chinese, Galician, Hindi, Japanese, Korean, Norwegian, Russian, Turkish, and Ukrainian.
• License: Apache License 2.0.

Citation

If you use EuroMoE-2.6B-A0.6B in your work, please cite the report.

@misc{euromoe,
  title = {EuroMoE-2.6B-A0.6B: Technical Report},
  author = {Duarte M. Alves and Miguel Moura Ramos and Hippolyte Gisserot-Boukhlef and João Alves and Pedro Henrique Martins and Patrick Fernandes and José Pombal and Nuno M. Guerreiro and Ricardo Rei and Amin Farajian and José G. C. de Souza and Pierre Colombo and André F. T. Martins},
  year = {2026}
}