A cli script to parse the usual sitemap resources of a website (e.g. robots.txt, sitemap.xml, etc)
This is really just a front end for the ultimate-sitemap-parser, so all credit to them!
- Initialize a venv (optional)
python3 -m venv .venv
pip3 install -r requirements.txt- Run
python3 smp.py "<target url>"
# Get help with the -h flag