Skip to content

A bert tokenizer implementting by Java, especially for Chinese, dedicated to compatibility with huggingface bert tokenizer

License

Notifications You must be signed in to change notification settings

chuangfengwang/hf-bert-tokenizer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

hf-bert-tokenizer

A bert tokenizer implementting by Java, especially for Chinese, dedicated to compatibility with huggingface bert tokenizer

About

A bert tokenizer implementting by Java, especially for Chinese, dedicated to compatibility with huggingface bert tokenizer

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published