Permalink
Commits on Oct 6, 2017
  1. Bump version to 1.1.6

    fredrikekelund committed Oct 6, 2017
Commits on Sep 29, 2017
  1. Merge pull request #398 from HaroldPutman/cookies-node7

    fredrikekelund committed Sep 29, 2017
    Send proper outbound cookie header
  2. Merge pull request #400 from robinparisi/master

    fredrikekelund committed Sep 29, 2017
    Fix wrong meta robots tag attribute
Commits on Sep 23, 2017
Commits on Sep 20, 2017
  1. Send proper outbound cookie header

    HaroldPutman committed Sep 20, 2017
    Outbound cookies should only include name and value in the header.
    In Node.js versions < 8 if `header.cookie` is set to an array, the values a concatenated with commas which is wrong [according to the specs](https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Cookie). This was [fixed in Node 8](nodejs/node#11259), but for compatibility if we join the cookie values and set `header.cookie` to a string it will always be right.
    
    To avoid breakage, `crawler.cookies.getAsHeader()` still returns an array, but without the unexpected attributes. When it is added to request options it is joined into a semicolon-separated string.
Commits on Aug 15, 2017
  1. Bumped version to 1.1.5

    fredrikekelund committed Aug 13, 2017
Commits on Aug 14, 2017
  1. Change intro paragraph in README

    cgiffard committed Aug 14, 2017
    The tone of voice in the introduction gave the impression that simplecrawler originated from a sole author (which in the beginning, it did.) This has been subtly adjusted to reflect that simplecrawler is a community effort.
Commits on Aug 9, 2017
  1. Merge pull request #393 from konstantinblaesi/fix-issue-385

    fredrikekelund committed Aug 9, 2017
    Use latest URI.js, which has improved validation logic.
  2. Use latest URI.js, which has improved validation logic.

    Konstantin Bläsi committed Aug 9, 2017
    Fixes #385
Commits on Aug 7, 2017
  1. Merge pull request #389 from konstantinblaesi/fix-appveyor-config

    cgiffard committed Aug 7, 2017
    Fix AppVeyor configuration.
Commits on Jul 28, 2017
  1. Fix AppVeyor configuration.

    konstantinblaesi committed Jul 28, 2017
    Adding package-lock.json in 30e38b9 broke node 8.x tests with AppVeyor CI.
Commits on Jul 25, 2017
  1. Added package-lock.json

    fredrikekelund committed Jul 25, 2017
  2. Merge pull request #382 from elxa/fix-issue-364

    fredrikekelund committed Jul 25, 2017
    Performance optimization for very large sitemaps.
Commits on Jul 24, 2017
  1. Update README.md to reflect dropped support for Node.js 0.X

    Konstantin Bläsi committed Jul 21, 2017
  2. Use strict mode.

    Konstantin Bläsi committed Jul 20, 2017
  3. Bump minimum required node version to 4.X

    Konstantin Bläsi committed Jul 20, 2017
  4. Enable ECMAScript 6 in eslint.

    Konstantin Bläsi committed Jul 20, 2017
  5. Performance optimization for very large sitemaps.

    Konstantin Bläsi committed Jul 20, 2017
    Fixes #364
Commits on Jul 16, 2017
  1. Bumped version to 1.1.4

    fredrikekelund committed Jul 16, 2017
  2. Merge pull request #378 from venning/master

    fredrikekelund committed Jul 16, 2017
    Fixes multiple issues with removeFetchCondition & removeDownloadCondition
  3. Updated JSDoc comments for Crawler#removeFetchCondition and Crawler#r…

    fredrikekelund committed Jul 16, 2017
    …emoveDownloadCondition
  4. Remove REMOVED_CONDITION constant

    fredrikekelund committed Jul 16, 2017
Commits on Jul 12, 2017
  1. the linter preferred {} over new Object()

    venning committed Jul 12, 2017
  2. removeFetch/DownloadCondition: tests: created sub-sections for easier…

    venning committed Jul 12, 2017
    … output visualization
  3. removeFetch/DownloadCondition: added tests for removing when you have…

    venning committed Jul 12, 2017
    … multiple conditions
  4. removeFetch/DownloadCondition: conditionIDs are now stable between re…

    venning committed Jul 12, 2017
    …move calls; tests updated
  5. removeFetch/DownloadCondition: throw error if condition is not remove…

    venning committed Jul 12, 2017
    …d or index is out of bounds