Skip to content

allnulled/scrapero

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

scrapero

Starts express server to put JSON data into filesystem.

Resilient way to run web scraps with minimal supervision.

Installation

$ npm i -s scrapero

Or globally:

$ npm i -g scrapero

Usage

API usage (server)

const server = require("scrapero").start(8080);

CLI usage (server)

$ scrapero --port 9898 --storage ./data

Browser usage (client)

  1. Download Greasemonkey or Tampermonkey.
  2. Copy and paste script at /browser.js in a new xMonkey script.
  3. Add the scraps you want to carry on.
  4. Browse to your target URLs.
  5. Click the top button which says "Scrap it".

Happy scrapping!

License

WTFPL or 'do What The Fuck you want to Public License'.

About

Starts express server to put json data into files.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published