Multilingual tokenizer that automatically tags each token with its type
multilingual
german
tokenizer
tagging
latin
french
hindi
wink
devanagari
marathi
tokenization
konkani
-
Updated
Mar 4, 2023 - JavaScript