GitHub - gflarity/WolfSpider: Setup scraping rules in javascript using JQuery then drag links selectively to scrape.

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 5 Commits
node_modules		node_modules
plugins		plugins
public		public
README		README
app.js		app.js
plugin.js		plugin.js

Repository files navigation

This is Node.JS based manual web scraper. I've included a file that works with 500px.com. To run:

> node app.js

Then open http://localhost:4000/drag.html, move it into a small window that you can drag onto from another browser window.

Goto http://500px.com/popular

Drag a thumbnail onto the drag window.

A folder should get created with the photographers username, the image will be inside.

More later.