Basic JS crawler

Usage

1. Create a new item in your bookmark bar and add the contents of dist/crawler.min.txt as the URL.
2. Load a web-page which you wish to crawl
3. Click "JS Crawler" link just added to your bookmark bar
4. Leave the page open until the crawl has completed

Currently there is no visual aid to the crawl but basic stats can be found in the developer console.

Example