Skip to content

HuggingFaceTokenizer took 90ms to process 10^5 length text #2846

Closed
Rfank2021 started this conversation in Development
Discussion options

You must be logged in to vote

Replies: 4 comments 5 replies

Comment options

You must be logged in to vote
2 replies
@Rfank2021
Comment options

@Rfank2021
Comment options

Comment options

You must be logged in to vote
2 replies
@frankfliu
Comment options

@Rfank2021
Comment options

Comment options

You must be logged in to vote
0 replies
Comment options

You must be logged in to vote
1 reply
@Rfank2021
Comment options

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
2 participants