opus-mt-ukr-flores-devtest.md

OPUS-MT models for Ukrainian

The following tables list the best OPUS-MT models for translating from and to Ukrainian according to the flores101 devtest benchmark. Results are given in standard BLEU scores (using sacrebleu).

Translations from Ukrainian

language pair	lang-IDs	BLEU	model
Ukrainian-Bulgarian	ukr-bul	30.9	zle-zls/opusTCv20210807+bt_transformer-big_2022-03-16
Ukrainian-Catalan	ukr-cat	16.7	zle-roa/opus1m-2021-02-18
Ukrainian-Czech	ukr-ces	25.1	zle-zlw/opusTCv20210807+bt_transformer-big_2022-03-23
Ukrainian-Danish	ukr-dan	30.3	zle-gmq/opusTCv20210807+pft_transformer-big_2022-03-14
Ukrainian-German	ukr-deu	28.1	zle-deu/opusTCv20210807_transformer-big_2022-03-19
Ukrainian-English	ukr-eng	39.2	zle-eng/opusTCv20210807+bt_transformer-big_2022-03-17
Ukrainian-Finnish	ukr-fin	21.1	zle-fin/opusTCv20210807+xb+bt+pft+pbt_transformer-big_2022-04-18
Ukrainian-French	ukr-fra	35.1	zle-fra/opusTCv20210807_transformer-big_2022-03-23
Ukrainian-Croatian	ukr-hrv	24.6	zle-zls/opusTCv20210807+bt_transformer-big_2022-03-23
Ukrainian-Hungarian	ukr-hun	20.2	ukr-hun/opusTCv20210807+pft_transformer-align_2022-03-08
Ukrainian-Italian	ukr-ita	23.2	zle-ita/opusTCv20210807_transformer-big_2022-03-19
Ukrainian-Latvian	ukr-lav	21.4	zle-bat/opusTCv20210807_transformer-align_2022-03-14
Ukrainian-Lithuanian	ukr-lit	21.0	ukr-lit/opusTCv20210807+bt+pbt+pft-sepvoc_transformer-tiny11-align_2022-03-17
Ukrainian-Macedonian	ukr-mkd	26.3	zle-zls/opusTCv20210807+bt_transformer-big_2022-03-16
Ukrainian-Norwegian Bokmål	ukr-nob	21.1	zle-gmq/opusTCv20210807+pft_transformer-big_2022-03-14
Ukrainian-Polish	ukr-pol	18.8	zle-zlw/opusTCv20210807+bt_transformer-big_2022-03-23
Ukrainian-Portuguese	ukr-por	33.6	zle-por/opusTCv20210807_transformer-big_2022-03-23
Ukrainian-Romanian	ukr-ron	27.7	ukr-ron/opusTCv20210807+pft_transformer-align_2022-03-08
Ukrainian-Russian	ukr-rus	28.3	zle-zle/opusTCv20210807+bt_transformer-big_2022-03-07
Ukrainian-Slovak	ukr-slk	22.1	ukr-ces+slk/opusTCv20210807+pft_transformer-align_2022-03-17
Ukrainian-Slovenian	ukr-slv	24.2	zle-zls/opusTCv20210807+bt_transformer-big_2022-03-23
Ukrainian-Spanish	ukr-spa	22.7	zle-spa/opusTCv20210807_transformer-big_2022-03-23
Ukrainian-Serbian	ukr-srp_Cyrl	26.2	zle-zls/opusTCv20210807+bt_transformer-big_2022-03-23
Ukrainian-Swedish	ukr-swe	28.8	zle-gmq/opusTCv20210807+pft_transformer-big_2022-03-14
Ukrainian-Turkish	ukr-tur	20.5	ukr-tur/opusTCv20210807+pft_transformer-align_2022-03-07

Translations to Ukrainian

language pair	lang-IDs	BLEU	model
Bosnian-Ukrainian	bos-ukr	16.0	sla-sla/opus-2021-02-18
Bulgarian-Ukrainian	bul-ukr	22.9	zls-zle/opusTCv20210807+bt_transformer-big_2022-03-23
Czech-Ukrainian	ces-ukr	22.9	zlw-zle/opusTCv20210807+bt_transformer-big_2022-03-19
Danish-Ukrainian	dan-ukr	25.5	gmq-zle/opusTCv20210807+pbt_transformer-big_2022-03-23
German-Ukrainian	deu-ukr	24.2	deu-zle/opusTCv20210807_transformer-big_2022-03-23
English-Ukrainian	eng-ukr	32.1	eng-zle/opusTCv20210807+bt_transformer-big_2022-03-13
Finnish-Ukrainian	fin-ukr	21.0	fin-zle/opusTCv20210807+xb+bt+pft+pbt_transformer-big_2022-04-27
French-Ukrainian	fra-ukr	23.1	fra-zle/opusTCv20210807_transformer-big_2022-03-23
Croatian-Ukrainian	hrv-ukr	21.9	zls-zle/opusTCv20210807+bt_transformer-big_2022-03-23
Hungarian-Ukrainian	hun-ukr	19.8	hun-ukr/opusTCv20210807+pbt_transformer-align_2022-03-08
Italian-Ukrainian	ita-ukr	18.3	ita-zle/opusTCv20210807_transformer-big_2022-03-23
Latvian-Ukrainian	lav-ukr	19.2	bat-zle/opusTCv20210807_transformer-align_2022-03-13
Lithuanian-Ukrainian	lit-ukr	19.5	bat-zle/opusTCv20210807_transformer-align_2022-03-13
Macedonian-Ukrainian	mkd-ukr	22.5	zls-zle/opusTCv20210807+bt_transformer-big_2022-03-23
Norwegian Bokmål-Ukrainian	nob-ukr	21.6	gmq-zle/opusTCv20210807+pbt_transformer-big_2022-03-23
Polish-Ukrainian	pol-ukr	18.3	zlw-zle/opusTCv20210807+bt_transformer-big_2022-03-19
Portuguese-Ukrainian	por-ukr	25.1	por-zle/opusTCv20210807_transformer-big_2022-03-23
Romanian-Ukrainian	ron-ukr	22.3	ron-ukr/opusTCv20210807+pbt_transformer-align_2022-03-08
Russian-Ukrainian	rus-ukr	25.5	zle-zle/opusTCv20210807+bt_transformer-big_2022-03-07
Slovak-Ukrainian	slk-ukr	21.4	ces+slk-ukr/opusTCv20210807+pbt_transformer-align_2022-03-08
Slovenian-Ukrainian	slv-ukr	20.2	zls-zle/opusTCv20210807+bt_transformer-big_2022-03-23
Spanish-Ukrainian	spa-ukr	17.4	spa-zle/opusTCv20210807_transformer-big_2022-03-23
Serbian-Ukrainian	srp_Cyrl-ukr	24.4	zls-zle/opusTCv20210807+bt_transformer-big_2022-03-23
Serbian-Ukrainian	srp-ukr	17.6	sla-sla/opus-2021-02-18
Swedish-Ukrainian	swe-ukr	25.7	gmq-zle/opusTCv20210807+pbt_transformer-big_2022-03-23
Turkish-Ukrainian	tur-ukr	19.9	tur-ukr/opusTCv20210807+pbt_transformer-align_2022-03-07