- Total number of unique language pairs: 44
- Total number of benchmarks: 52
Training data for the models reported below comes from JW300 unless indicated otherwise (in brackets). For details about data source, preprocessing, training configurations etc. check the notebooks provided in the folders linked for each language pair.
The Test BLEU score is computed on the JW300 test sets with SacreBLEU (tokenize=None to maintain the original JW300 tokenization).
| Source | Target | Best Test BLEU | Link | Avalailable on Masakhane-web |
|---|---|---|---|---|
| English | Afrikaans (Autshumato) | 19.56 | link | ❌ |
| English | Afrikaans (JW300) | 45.48 | link | ❌ |
| English | Amharic | 2.03 | link | ❌ |
| English | Arabic (TED, custom) | 9.28 | link | ❌ |
| English | Cinyanja | 30 | link | ❌ |
| English | Dendi | 22.30 | link | ❌ |
| English | Efik | 33.48 | link | ❌ |
| English | Ẹ̀dó | 12.49 | link | ❌ |
| English | Ẹ̀sán | 6.25 | link | ❌ |
| English | Fon | 31.07 | link | ❌ |
| English | Hausa | 41.11 | link | ❌ |
| English | Igbo | 34.85 | link | ✔️ |
| English | Isoko | 38.91 | link | ❌ |
| English | Kamba | 27.90 | link | ❌ |
| English | Kimbundu | 32.76 | link | ❌ |
| English | Kikuyu | 37.85 | link | ❌ |
| English | Lingala | 48.64 | link | ✔️ |
| English | Luo | 34.33 | link | ❌ |
| English | Nigerian Pidgin | 24.29 | link | ❌ |
| English | Northern Sotho (Autshumato) | 19.56 | link | ❌ |
| English | Northorn Sotho (JW300) | 15.40 | link | ❌ |
| English | Sesotho | 41.23 | link | ❌ |
| English | Setswana | 19.66 | link | ✔️ |
| English | Shona | 30.84 | link | ✔️ |
| English | Southern Ndebele | 4.01 | link | ❌ |
| English | Southern Ndebele | 26.61 | link | ❌ |
| English | kiSwahili (JW300) | 51.70 | link | ✔️ |
| English | kiSwahili (SAWA) | 3.60 | link | ❌ |
| English | kiSwahili (SAWA+JW300) | 17.61 | link | ❌ |
| English | Tigrigna (JW300) | 4.02 | link | ❌ |
| English | Tigrigna (JW300+Tatoeba+more) | 14.88 | link | ❌ |
| English | Tiv | 44.70 | link | ❌ |
| English | Tshiluba | 42.52 | link | ✔️ |
| English | Tshivenda | 49.57 | link | ❌ |
| English | Twi | 34.57 | link | ❌ |
| English | Urhobo | 28.82 | link | ❌ |
| English | isiXhosa (Autshumato) | 13.32 | link | ❌ |
| English | isiXhosa (JW300) | 6.00 | link | ❌ |
| English | Xitsonga (JW300) | 4.44 | link | ❌ |
| English | Xitsonga (Autshumato) | 13.54 | link | ❌ |
| English | Yoruba | 38.62 | link | ❌ |
| English | isiZulu (Autshumato) | 1.96 | link | ❌ |
| English | isiZulu (JW300) | 4.87 | link | ❌ |
| Efik | English | 33.68 | link | ❌ |
| Hausa | English | 25.27 | link | ❌ |
| Yoruba | English | 39.44 | link | ✔️ |
| French | Lingala | 39.81 | link | ❌ |
| French | Swahili Congo | 33.73 | link | ❌ |
| Nigerian Pidgin | English | 24.95 | link | ❌ |
| Tshivenda | English | 46.82 | link | ❌ |
| Southern Ndebele | English | 40.56 | link | ❌ |
| Afrikaans (JW300) | English | 57.22 | link | ❌ |