Skip to content
Simple pyrhon script that crawls websites and outputs their domain to a text file
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
README.md
UrlCrawler.py

README.md

Url-Crawler

Simple python script that crawls websites and outputs their domain to a text file

#Usage Simple web crawler that uses the base url specified in the file and it crawls for the specified amount of websites and logs their domain to a text file.

You can’t perform that action at this time.
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.