Skip to content

Multithreaded Python application to search a string pattern or find all internal links from a url or CSV list of urls

Notifications You must be signed in to change notification settings

springload/site-url-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

46 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Site url scraper

Multithreaded Python application to search a string pattern or find all internal links from a url or CSV list of urls

/!\ This project isn't actively maintained. Check alternatives like pylinkchecker or broken-link-checker /!\

Installation

git clone REPOSITORY_URL
cd site-url-scraper
pip install -e .

Usage

python GLSapp/Main.py --help

About

Multithreaded Python application to search a string pattern or find all internal links from a url or CSV list of urls

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages