Does the hf to .nemo conversion supports only tokenizer.model, not tokenizer.json?? #12489

amalch20 · 2025-03-05T04:13:33Z

amalch20
Mar 5, 2025

Does the hf to .nemo conversion supports only tokenizer.model, not tokenizer.json??

ashors1 · 2025-05-01T21:38:58Z

Hi, could you share some details on the particular conversion you're running? HuggingFace tokenizers should generally be supported.

0 replies