Skip to content

A simple WebCrawler for exploring and downloading content from web pages within a given domain/url.

License

Notifications You must be signed in to change notification settings

Th3-C0der/Web-Crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

34 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

A Simple WebCrawler Made In Python for exploring and downloading content from web pages within a given Domain/URL.

Typing SVG

About Tool:

  • This Tool Crawls The Given URL/Domain And Collects The HTML File Of Each WebPage And Compresses Them Into Zip Archive For Downloading.
  • My First Original Tool ^_^

INSTALLATION :

  • apt update -y
  • apt upgrade -y
  • pkg install python -y
  • pkg install git
  • git clone https://github.com/Th3-C0der/Web-Crawler
  • ls
  • cd Web-Crawler
  • pip install -r requirements.txt

RUN!:

  • cd Web-Crawler
  • python main.py
  • Open This Url On Your Browserhttp://127.0.0.1:5000

UPDATE :

  • To Update Script →python update.py

Th3-C0der