Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

英文不能分词吧 #14

Open
miaotiao opened this issue Feb 17, 2022 · 3 comments
Open

英文不能分词吧 #14

miaotiao opened this issue Feb 17, 2022 · 3 comments

Comments

@miaotiao
Copy link

image
@lizhichao
Copy link
Owner

词库里面有就可以分，你可以在词库里面添加空格 或者 英文单词

@miaotiao
Copy link
Author

英文单词目前检索到的数量至少 20W 吧，参考
所以英文的话， 应该使用空格，词典的大小和兼容性会更好吧（不考虑英文单词的专有名词，带有标点的缩写等）
如果这样，空格和英文标点是否可以放入默认的词典里呢

@lizhichao
Copy link
Owner

可以添加空格和英文标点到词库引文就能分了，你可以针对不同的场景设置自己的词库

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@lizhichao @miaotiao