Skip to content
This repository

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
branch: master

Fetching latest commit…

Octocat-spinner-32-eaf2f5

Cannot retrieve the latest commit at this time

..
Octocat-spinner-32 README.md
Octocat-spinner-32 package.json
Octocat-spinner-32 server.js
Octocat-spinner-32 stormapp.js
README.md

Distributed Web Crawler Sample

A distributed web crawler sample. A central server has queues with links to process. The topology can be manually launched in many nodes.

Install

Execute

npm install

to install the dependencies.

Usage

Launch the server

node server.js <url> [<url>... ]

Example

node server.js http://ajlopez.wordpress.com

Launch one or more clients

node stormnode.js
Something went wrong with that request. Please try again.