Official resources for "A Benchmark for Evaluating Machine Translation Metrics on Dialects Without Standard Orthography"

Official resources for ["A Benchmark for Evaluating Machine Translation Metrics on Dialects Without Standard Orthography"](https://aclanthology.org/2023.wmt-1.99/, published at WMT 2023.

In the evaluation directory, you can find:

• the Swiss German translations of NTREX-128
• the systems translations and the human ratings
• the challenge set
• the code to evaluate metrics on our test sets.
• In the training directory, you can find the code for training the neural metrics evaluated in the paper.