From 413d1bfec27434cf8dae2574dafcff6399d84078 Mon Sep 17 00:00:00 2001 From: saucerman Date: Sun, 11 Nov 2018 22:46:01 +0800 Subject: [PATCH] update --- README.md | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/README.md b/README.md index 5238cf8..755145d 100644 --- a/README.md +++ b/README.md @@ -1,10 +1,16 @@ UrlCrawler + author : saucerman + description: python写的全站url爬取脚本,爬取网站的全部url用于分析站点目录 ## 说明 暂未使用多进程或多线程,速度不快,可自行修改源码 +基本思想如下所示: + +![](http://ww1.sinaimg.cn/large/005GjT4tgy1fx4i98ipkqj30ji091wev.jpg) +