from baidubaike get the corpus
从百度百科爬取中文语料库
采用单个初始界面爬取的词条数比较少，用‘科学’爬到7W+词条，用比较笨的办法，多用几个初始界面，尽量使用与自己项目相关的词汇
更新，采用多进程+多线程方式，增加爬取速度
添加词向量训练语料预处理及模型训练代码
forked from newer-plus/baidubaike-corpus
-
Notifications
You must be signed in to change notification settings - Fork 0
znsoftm/baidubaike-corpus
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
from baidubaike get the corpus
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published
Languages
- Python 100.0%