introduce arabic to normalized sacrebleu

[pklpriv]

No description provided.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 89.50%. Comparing base (8fa7674) to head (9ae2bb3).

❗ Current head 9ae2bb3 differs from pull request most recent head b1f27d2. Consider uploading reports for the commit b1f27d2 to get more accurate results

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #638      +/-   ##
==========================================
+ Coverage   89.48%   89.50%   +0.01%     
==========================================
  Files          90       90              
  Lines        8744     8566     -178     
==========================================
- Hits         7825     7667     -158     
+ Misses        919      899      -20     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[piotrhelm]

@pklpriv Can you add support for Korean also?

[LukaszCmielowski]

@yoavkatz could you please take a look and merge ?. Thx.