Skip to content

Commit

Permalink
Updated README
Browse files Browse the repository at this point in the history
  • Loading branch information
chriso committed Nov 17, 2010
1 parent 9ce4c64 commit 01eb509
Showing 1 changed file with 10 additions and 9 deletions.
19 changes: 10 additions & 9 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# [node.io](http://node.io/)

A distributed data scraping and processing engine for [Node.JS](http://nodejs.org/)
A distributed data scraping and processing engine for [Node.js](http://nodejs.org/)

To install node.io, use [npm](http://github.com/isaacs/npm):

Expand All @@ -14,27 +14,28 @@ For usage details, run

- Create modular and extensible jobs for scraping and processing data
- Seamlessly distribute work among child processes and other servers (soon)
- Written in Node.JS = FAST
- Handles a variety of input / output situations
- Written in Node.js == FAST
- Handles a variety of input / output
* Reading / writing lines to and from files
* Reading all files in a directory (and recursing if specified)
* To / from a database
* STDIN / STDOUT
* Piping between node.io jobs
* Piping between other node.io jobs
* Custom IO / any combination of the above
- Includes a robust framework for scraping and selecting web data
- Support for a variety of proxies when making requests
- Includes a data validation and sanitization framework
- Provides support for retries, timeouts, dynamically adding input, etc.
- Create a MapReduce cluster

## Examples
## Documentation

See ./examples
Initial documentation is [available here](https://github.com/chriso/node.io/tree/master/docs/).

## Documentation
Better documentation will be available once I have time to write it. See [http://node.io/](http://node.io/) for updates.

## Examples

Coming soon. See [http://node.io/](http://node.io/) for updates
See [./examples](https://github.com/chriso/node.io/tree/master/examples/)

## Roadmap

Expand Down

0 comments on commit 01eb509

Please sign in to comment.