Skip to content

nikan1996/PyScraper

Repository files navigation

PyScraper: A fast web crawling system for humans

cute-cat

PyScraper is based on scrapy(but I will replace this spider engine in the future for more custom requirements). PyScraper is devloped for Python3.6 or later.

TODO: 1. 补充ProjectHandler及其接口的测试。 2. 区分增量表和全量表 2种表格。

Changelog: [1.0] 2018-06-08 ### FIXED: - 爬虫脚本更新时,界面能实时加载出最新爬虫模块目录。

About

A fast web crawling system for humans:smirk:

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published