This is a scraper for index sites. They are file systems and, as such, will force you to go in them one by one in order to download.
This is a script built with puppeteer and typescript that allows you to mass-download those files.
- download node if you haven't already
- navigate to the directory
- run
npm install - create a
.envfile with the keysURLandFOLDER(optional) pointing to the correct url and folder to output to in the downloads folder - run
npm run start - find files in downloads/
<folder_name>