This repository has been archived by the owner on Mar 7, 2021. It is now read-only.

simplecrawler 0.6.2

cgiffard released this 15 Feb 10:42

· 334 commits to master since this release

Features

simplecrawler now respects redirects declared via <meta> tags in HTML (#216, #190) (@fredrikekelund)
We now provide the queueItem of the referring resource to fetchConditions (#217, #114) (@fredrikekelund)

Code Hygiene

Cleaned up test harness (@fredrikekelund)
Improved test speed (@fredrikekelund)
Updated lint rules and upgraded to ESLint 2.0 (@XhmikosR)
Updated travis.yml to include older and newer versions of node (@XhmikosR)
Removed a few comments and did some general tidying (@fredrikekelund)

Bugs

Fixed issue where malformed cookies would crash the crawler (#215, #184) (@fredrikekelund)
Fixed issue where fetchdataerror conditions would cause the crawler to hang in some circumstances (#214, #213) (@fredrikekelund)

Assets 2