__          __  _        _____                    _           
 \ \        / / | |      / ____|                  | |          
  \ \  /\  / /__| |__   | |     _ __ __ ___      _| | ___ _ __ 
   \ \/  \/ / _ \ '_ \  | |    | '__/ _` \ \ /\ / / |/ _ \ '__|
    \  /\  /  __/ |_) | | |____| | | (_| |\ V  V /| |  __/ |   
     \/  \/ \___|_.__/   \_____|_|  \__,_| \_/\_/ |_|\___|_|   
                                                               
                                                               

A web crawler script that crawls the target website and lists its links

Module to be installed

• Installation for Linux

sudo pip install -r requirements.txt

• Windows Installation

python -m pip install -r .\requirements.txt

Use

• Example 1

python spider.py --url http://10.0.2.6/mutillidae

• Example 2

python spider.py -u http://10.0.2.6/mutillidae