jianshuCrawler

使用nodejs + cheerio爬取简书首页文章信息

待实现的功能:
[]1.获取动态分页的数据
[x]2.支持多线程
[x]3.基于IP池爬取数据

Name		Name	Last commit message	Last commit date
Latest commit History 24 Commits
model		model
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
cheerio_load.js		cheerio_load.js
container.html		container.html
crawler.js		crawler.js
crawler_sg.js		crawler_sg.js
crawler_trending.js		crawler_trending.js
db_process.js		db_process.js
jianshu.html		jianshu.html
package-lock.json		package-lock.json
package.json		package.json

Provide feedback