[meta] Train harder to segment languages, like CJK languages

[gregtatum]

For harder to segment languages we have Chinese, Japanese, and Korean. We'll need to implement better tokenization support and segmentation support for these languages in order to train them. This work should happen after training a subset of the easier to segment language in #524.

Tasks

Beta Give feedback

1. Monolingual data has a word splitter that won't work for CJK #424
   language-coverage +1
2. Support Chinese discussion #45
   language-coverage +1
3. Bump bicleaner-ai dependency #378
   language-coverage +1
4. Bug 1820618 - TranslationsDocument should use a word segmenter not a regex to support CJK-like languages

Native Speakers

If you are a native speaker (L1 language) in any of these languages and want to help out, feel free to leave a comment on this issue or join us in Firefox Translations on matrix. We can always use help with qualitative model evaluation, and questions regarding language.