New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

词典中加入单词对分词影响的一个bug #222

Open

provenclei opened this issue Sep 27, 2021 · 0 comments

provenclei commented Sep 27, 2021

在字典加入的单词中以已有单词的后一个字开头的新单词，与已有单词放一起分词时会有问题！

例如：
马达加斯加普通话版（字典中加入马达加斯加/ip 加普/star 普通话版/other）

分词结果为：马达加斯加普通话版

张继科比赛（字典中加入张继科/star 科比/star）

分词结果：张继科比赛

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment