Utility to crawl and diff websites for node.js
JavaScript
Pull request Compare This branch is 2 commits ahead, 10 commits behind mmoulton:master.
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
bin
lib
test
.gitignore
.travis.yml
LICENSE
README.md
index.js
package.json

README.md

Crawl - a website crawler / differencer

Install

npm install crawl -g

Usage

Usage: crawl left [right]

Options:
  -v, --verbose  Verbose logging                                  [boolean]
  -j, --json     Output results in JSON format                    [boolean]
  -h, --headers  Include the raw response headers in the results  [boolean]
  -b, --body     Include the raw response body in the results     [boolean]

You must define at least one path to crawl.