Skip to content

EmNudge/index-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

index-scraper

This is a scraper for index sites. They are file systems and, as such, will force you to go in them one by one in order to download.

This is a script built with puppeteer and typescript that allows you to mass-download those files.

Usage

  1. download node if you haven't already
  2. navigate to the directory
  3. run npm install
  4. create a .env file with the keys URL and FOLDER(optional) pointing to the correct url and folder to output to in the downloads folder
  5. run npm run start
  6. find files in downloads/<folder_name>

About

Scrape website indexes using puppeteer

Resources

Stars

1 star

Watchers

1 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors