Skip to content
python写的全站url爬取脚本,爬取网站的全部url用于分析站点目录
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
README.md update Nov 11, 2018
crawler.py

README.md

UrlCrawler

author : saucerman

description: python写的全站url爬取脚本,爬取网站的全部url用于分析站点目录

说明

暂未使用多进程或多线程,速度不快,可自行修改源码

基本思想如下所示:

You can’t perform that action at this time.