Skip to content


Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
Browse files

Updated README

  • Loading branch information...
commit 01eb5093c2fd23ec14c0b77de4a2c65e2b45f5c6 1 parent 9ce4c64
@chriso authored
Showing with 10 additions and 9 deletions.
  1. +10 −9
@@ -1,6 +1,6 @@
# [](
-A distributed data scraping and processing engine for [Node.JS](
+A distributed data scraping and processing engine for [Node.js](
To install, use [npm](
@@ -14,27 +14,28 @@ For usage details, run
- Create modular and extensible jobs for scraping and processing data
- Seamlessly distribute work among child processes and other servers (soon)
-- Written in Node.JS = FAST
-- Handles a variety of input / output situations
+- Written in Node.js == FAST
+- Handles a variety of input / output
* Reading / writing lines to and from files
* Reading all files in a directory (and recursing if specified)
* To / from a database
- * Piping between jobs
+ * Piping between other jobs
* Custom IO / any combination of the above
- Includes a robust framework for scraping and selecting web data
- Support for a variety of proxies when making requests
- Includes a data validation and sanitization framework
- Provides support for retries, timeouts, dynamically adding input, etc.
-- Create a MapReduce cluster
-## Examples
+## Documentation
-See ./examples
+Initial documentation is [available here](
-## Documentation
+Better documentation will be available once I have time to write it. See []( for updates.
+## Examples
-Coming soon. See []( for updates
+See [./examples](
## Roadmap
Please sign in to comment.
Something went wrong with that request. Please try again.