Permalink
Switch branches/tags
Nothing to show
Commits on Oct 31, 2017
  1. Update outdated Dockerfile

    vshlapakov committed Oct 31, 2017
Commits on Feb 9, 2017
Commits on Jan 26, 2017
  1. Merge pull request #8 from scrapinghub/update-reqs

    vshlapakov committed Jan 26, 2017
    Drop outdated pinned version for sh-scrapy
Commits on Oct 5, 2016
  1. Update sh-ep-scrapy version

    vshlapakov committed Oct 5, 2016
Commits on Jul 29, 2016
  1. Typo fix for urlparse import

    vshlapakov committed Jul 29, 2016
Commits on Apr 12, 2016
  1. Merge pull request #7 from scrapinghub/add-broken-link-spider

    akarthik86 committed Apr 12, 2016
    Added: Spider for detecting broken links of a given website
Commits on Mar 25, 2016
  1. Added: Multile changes

    starrify committed Mar 25, 2016
Commits on Mar 15, 2016
  1. Fixed: Ignoring status 5xx

    starrify committed Mar 15, 2016
Commits on Mar 3, 2016
  1. Merge pull request #6 from scrapinghub/py3-followall

    dangra committed Mar 3, 2016
    PY3: handle cookies as bytes
Commits on Feb 15, 2016
  1. PY3: handle cookies as bytes

    redapple committed Feb 15, 2016
Commits on Nov 13, 2015
  1. Add a spider that does nothing

    dangra committed Nov 13, 2015
Commits on Sep 3, 2015
Commits on Aug 24, 2015
Commits on Aug 16, 2015
  1. abs current dir

    dangra committed Aug 16, 2015
  2. add localinfo spider

    dangra committed Aug 16, 2015
Commits on Aug 10, 2015
Commits on May 8, 2015
  1. Merge pull request #4 from scrapinghub/kumo

    dangra committed May 8, 2015
    Kumo
Commits on May 5, 2015
  1. Add dockerfile

    dangra committed May 5, 2015
Commits on Mar 25, 2015
  1. add kumo integration

    dangra committed Mar 25, 2015
Commits on Jan 23, 2015
  1. Merge pull request #3 from mdelcambre/mdelcambre-patch-2

    dangra committed Jan 23, 2015
    lstrip will remove leading w within the domain
  2. lstrip will remove leading w within the domain

    mdelcambre committed Jan 23, 2015
    Replaced with regex. This will have some edge cases such as 'www.com' however will not strip leading w such as in whirlpool.com or domains ending in www (examplewww.com)
Commits on Jan 7, 2015
  1. Port to lxml linkextractor

    dangra committed Jan 7, 2015
Commits on Jul 23, 2014
Commits on May 26, 2014
  1. Merge pull request #1 from nyov/master

    dangra committed May 26, 2014
    api changes, update deprecated names
Commits on May 24, 2014
Commits on Feb 25, 2014
Commits on Oct 8, 2013
Commits on Sep 18, 2013
  1. use the recover method

    dangra committed Sep 18, 2013
  2. add spider contracts to test

    dangra committed Sep 18, 2013
Commits on Sep 6, 2013