Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP
Branch: master

Fetching latest commit…

Cannot retrieve the latest commit at this time

..
Failed to load latest commit information.
README.md
package.json
server.js
stormapp.js

README.md

Distributed Web Crawler Sample

A distributed web crawler sample. A central server has queues with links to process. The topology can be manually launched in many nodes.

Install

Execute

npm install

to install the dependencies.

Usage

Launch the server

node server.js <url> [<url>... ]

Example

node server.js http://ajlopez.wordpress.com

Launch one or more clients

node stormnode.js
Something went wrong with that request. Please try again.