Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
  • Loading branch information
saucer-man committed Nov 11, 2018
1 parent eebe58f commit 413d1bf
Showing 1 changed file with 6 additions and 0 deletions.
6 changes: 6 additions & 0 deletions README.md
@@ -1,10 +1,16 @@
UrlCrawler

author : saucerman

description: python写的全站url爬取脚本,爬取网站的全部url用于分析站点目录

## 说明

暂未使用多进程或多线程,速度不快,可自行修改源码

基本思想如下所示:

![](http://ww1.sinaimg.cn/large/005GjT4tgy1fx4i98ipkqj30ji091wev.jpg)



0 comments on commit 413d1bf

Please sign in to comment.