No description, website, or topics provided.
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.gitignore
README.md
broken_links_spider.py
config.py
requirements.txt

README.md

Usage

Configure urls to parse in config.py. Then, run:

scrapy runspider broken_links_spider.py -o output.json

Then check 404 items in the output.json file.