Skip to content

Issues: Hugging-Face-Supporter/tftokenizers

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

14 Open 4 Closed
14 Open 4 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Repository doesn't contain covert.py file
#22 opened Jun 15, 2023 by Captaindoggo
Can't reproduce the exampe in the Readme
#21 opened May 25, 2023 by IlnarSelimcan
3
Missing trace on some of the tokenizer functions bug Something isn't working enhancement New feature or request
#20 opened Apr 4, 2022 by MarkusSagen
@MarkusSagen
[Optional] Provide TFAutoModels for different head types enhancement New feature or request feature request New feature or functionality wanted good first issue Good for newcomers
#18 opened Mar 14, 2022 by MarkusSagen
Reduce tensorflow noise
#17 opened Mar 14, 2022 by MarkusSagen
Use built in function to access special tokens and ids bug Something isn't working enhancement New feature or request feature request New feature or functionality wanted
#16 opened Mar 13, 2022 by MarkusSagen
@MarkusSagen
Remove deprecated class TFTokenizerBase enhancement New feature or request good first issue Good for newcomers
#12 opened Mar 12, 2022 by MarkusSagen
@MarkusSagen
Describe how more tokenizers can be added documentation Improvements or additions to documentation
#11 opened Mar 12, 2022 by MarkusSagen
@MarkusSagen
BertTokenizer may not be optimal choice for converstion bug Something isn't working enhancement New feature or request
#10 opened Mar 12, 2022 by MarkusSagen
Provide examples for NER, QA, Classification examples documentation Improvements or additions to documentation feature request New feature or functionality wanted
#8 opened Mar 12, 2022 by MarkusSagen
Support GPT-sw3 feature request New feature or functionality wanted
#7 opened Mar 12, 2022 by MarkusSagen
Support T5 feature request New feature or functionality wanted
#6 opened Mar 12, 2022 by MarkusSagen
Tokenizer's model_max_length is not consistent bug Something isn't working
#3 opened Mar 12, 2022 by MarkusSagen
@MarkusSagen
Enable more tokenizers, s.a. SentencePiece enhancement New feature or request feature request New feature or functionality wanted
#2 opened Mar 12, 2022 by MarkusSagen
@MarkusSagen
ProTip! Find all open issues with in progress development work with linked:pr.