Skip to content

JScrapy是一个使用JavaScript语言来定时爬取网站内容的实践项目。JScrapy is a network spider based on JavaScript, which crawls target websites periodically.

SZ-Edward/JScrapy

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

JScrapy是一个使用JavaScript语言来定时爬取网站内容的实践项目。

项目技术 Tech Stack

NodeJS+Express+Request+cheerio 执行爬取任务
NodeCron 执行定时任务
MongoDB 存储爬取结果
jQuery DataTables 查询、分页展示不同站点的爬取结果(项目目录下html/show_result.html)
配置文件位于项目目录下的config.json

About

JScrapy是一个使用JavaScript语言来定时爬取网站内容的实践项目。JScrapy is a network spider based on JavaScript, which crawls target websites periodically.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published