Skip to content
Scrape website indexes using puppeteer
TypeScript
Branch: master
Clone or download
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
src initializing repo with project Jan 12, 2020
.gitignore initializing repo with project Jan 12, 2020
README.md
package-lock.json
package.json initializing repo with project Jan 12, 2020
tsconfig.json

README.md

index-scraper

This is a scraper for index sites. They are file systems and, as such, will force you to go in them one by one in order to download.

This is a script built with puppeteer and typescript that allows you to mass-download those files.

Usage

  1. download node if you haven't already
  2. navigate to the directory
  3. run npm install
  4. create a .env file with the keys URL and FOLDER(optional) pointing to the correct url and folder to output to in the downloads folder
  5. run npm run start
  6. find files in downloads/<folder_name>
You can’t perform that action at this time.