Skip to content
This repository has been archived by the owner on May 22, 2021. It is now read-only.

arshadkazmi42/crul

Repository files navigation

CRUL

  • Find all the links of parent same domain from the response of the input link.
  • Stores all links to output directory

Setup

pip install -r requirements.txt

Usage

$ python start.py {URL}

About

Crawl urls from pages

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages