python 爬虫
版本1 功能简述： 以hao123为入口页面，滚动爬取外链，收集网址，并记录网址上的内链和外链数目，记录title等信息
windows7 32位上测试，目前每24个小时，可收集数据为10万左右
forked from simapple/spider
-
Notifications
You must be signed in to change notification settings - Fork 5
python爬虫 全球网址URL滚动提取
sdfzy/spider
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
python爬虫 全球网址URL滚动提取
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published
Languages
- Python 100.0%