Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP
Tree: bc05fa1d47
Fetching contributors…

Cannot retrieve contributors at this time

33 lines (21 sloc) 0.87 kB

node.io

A distributed data scraping and processing engine for Node.JS

To install node.io, use npm:

$ npm install node.io

Run $ node.io --help for usage details

Why node.io?

  • Seamlessly distribute work across child processes and servers (soon)
  • Handles a variety of input / output situations
    • Reading / writing lines to and from files
    • To / from a database
    • STDIN / STDOUT
    • Piping between node.io jobs
    • Any combination of the above
  • Includes a robust framework for scraping and selecting HTML data
  • Support for proxied requests
  • Provides support for retries and timeouts

Examples

See ./examples

Documentation

Coming soon. See http://node.io/ for updates

This is a major work in progess.. check back soon!

Jump to Line
Something went wrong with that request. Please try again.