Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
JavaScript CoffeeScript Other
tree: bc05fa1d47

Fetching latest commit…

Cannot retrieve the latest commit at this time

Failed to load latest commit information.
bin
examples
lib/node.io
test
LICENSE
README.md
index.js
package.json

README.md

node.io

A distributed data scraping and processing engine for Node.JS

To install node.io, use npm:

$ npm install node.io

Run $ node.io --help for usage details

Why node.io?

  • Seamlessly distribute work across child processes and servers (soon)
  • Handles a variety of input / output situations
    • Reading / writing lines to and from files
    • To / from a database
    • STDIN / STDOUT
    • Piping between node.io jobs
    • Any combination of the above
  • Includes a robust framework for scraping and selecting HTML data
  • Support for proxied requests
  • Provides support for retries and timeouts

Examples

See ./examples

Documentation

Coming soon. See http://node.io/ for updates

This is a major work in progess.. check back soon!

Something went wrong with that request. Please try again.