Skip to content
Crawls emails from web pages
HTML JavaScript
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
spec
tests first commit Dec 3, 2017
.gitignore first commit Dec 3, 2017
README.md fix() README, usage Dec 4, 2017
email-filterer.js
email-regexp.js
html-parser-utils.js
package-lock.json
package.json
scraper.js

README.md

email-crawler

INSTALLATION

npm install email-crawler

USAGE

var Scraper = require("email-crawler");
var emailscraper = new Scraper("https://koptional.com");
// A level is how far removed (in  terms of link clicks) a page is from the root page (only follows same domain routes)
emailscraper.getLevels(2).then((emails) => {
  console.log(emails); // Here are the emails crawled from traveling two levels down this domain
})
.catch((e) => {
  console.log("error");
})

TESTS

sorry, I am using mocha and jasmine at this point but am hoping to move all to jasmine

./node_modules/mocha/bin/mocha tests/*.js --timeout=150000
./node_modules/jasmine-node/bin/jasmine-node spec

or simply

npm test

LICENSE

MIT

You can’t perform that action at this time.