Name		Name	Last commit message	Last commit date
Latest commit History 10 Commits
README.md		README.md
SpiderConfig.py		SpiderConfig.py
getProxies.py		getProxies.py
mylog.py		mylog.py
sqlserver.py		sqlserver.py
user_agent.txt		user_agent.txt

Repository files navigation

SpiderConfig

一个用于增量式爬虫的通用配置模版，可以获取目标url，获取目标html源码，字符串清洗，以及获取增量更新次数

About

一个用于增量式爬虫抓取目标url、目标html源码等功能的通用配置父类。

Report repository

Releases

No releases published

Packages

No packages published

Languages

Python 100.0%