Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
scraper in js
JavaScript
branch: master

Fetching latest commit…

Cannot retrieve the latest commit at this time

Failed to load latest commit information.
examples
vendor
.gitignore
README.md
app.js
btgames.js
jsdom_scraper.js
result_handler.js
scrape.sh
supersport.js
zombie_scraper.js

README.md

Whenagain scraper

Scrape by generating the dom and using sizzle selectors

Usage

To run the scrapers, run

   ./scrape.sh

You can do a dry run by using the --dry-run option. This will just print out all the items that were scraped and not attempt to push it somewhere.

Host and port to push to can be provided as the first and second parameters:

 ./scrape.sh localhost 12345

You can also run the jsdom scraper and the zombie scraper separately:

   node jsdom_scraper.js [args]
   // or
   node zombie_scraper.js [args]

Requirements

You need Node.js and the following node modules:

  • jsdom
  • zombie
  • underscore
Something went wrong with that request. Please try again.