Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

源码问题 #4

Closed
yanwen0614 opened this issue Jun 24, 2018 · 1 comment
Closed

源码问题 #4

yanwen0614 opened this issue Jun 24, 2018 · 1 comment

Comments

@yanwen0614
Copy link

yanwen0614 commented Jun 24, 2018

line 483中 ws 是否因为 sent
image
这是我的dubug信息

@yanwen0614
Copy link
Author

for n, sent in enumerate(sents):#self.texts(sents, filtering)):
if n % 10000 == 0 and n > 0:
logger.info(u'已处理了%s个句子' % n)
for ws in [sent.rsplit()]:
处理英文只需这样修改即可

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant