🕸️WebCraw

WebCraw is a small Python script that scans a website and finds all links on its pages.

Usage

pip install -r requirements.txt

python webcraw.py -u http://example.com

usage: webcraw.py [-h] -u URL [-o OUTPUT] [-s] [-g]

options:
  -h, --help            show this help message and exit
  -u URL, --url URL     url to scan
  -o OUTPUT, --output OUTPUT
                        output file
  -s, --silent          silent mode
  -g, --only-good       only show good links