Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

Already on GitHub? Sign in to your account

Filter by author
Filter by label
Use alt + click/return to exclude labels.
Filter by project
Filter by milestone
Filter by who’s assigned
char positions <> token positions
#105 opened Jan 24, 2020 by tscholak
"can't pickle Tokenizer objects"
#87 opened Jan 19, 2020 by 578123043
Compatibility with torchtext
#69 opened Jan 15, 2020 by joeddav
Why Rust?
#67 opened Jan 14, 2020 by andyalmonte
Comparison with YouTokenToMe
#66 opened Jan 14, 2020 by yutkin
JS / WebAssembly binding planned ?
#63 opened Jan 14, 2020 by mikbry
Support for multiple language!
#51 opened Jan 11, 2020 by adhaamehab
Tokenizer saving/loading
#15 opened Dec 27, 2019 by n1t0 0 of 3
Rust documentation
#10 opened Dec 27, 2019 by n1t0
You can’t perform that action at this time.