A fast node crawler
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
examples
lib
.hgignore
.hgtags
README.md
krowlr.co
package.json

README.md

node-krowlr

Installation

npm install krowlr

Usage

krowlr = require('krowlr');

crawler = new krowlr.Crawler()
crawler.add_url('http://mywesite/mypage')
crawler.accepted_domains.push('www.myotherdomain')
crawler.start()