Does ModernBERT support Chinese, if not, when will a Chinese version of ModernBERT be trained?

[CmyLjj]

Is it possible to train a Chinese version of ModernBERT?

[NohTow]

Hello,
ModernBERT has been trained on English data (and with an English tokenizer) so it will most likely have bad results on Chinese, see #143.
There is no direct plan for a multilingual version for now, so maybe you can give mGTE a shot, with xformers it should be quite efficient and it supports Chinese.

[MrRace]

@NohTow Is there a tutorial on how to train a Chinese version? I want to try it. Thanks a lot!

[neavo]

@NohTow Is there a tutorial on how to train a Chinese version? I want to try it. Thanks a lot!

see this https://huggingface.co/neavo/modern_bert_multilingual