Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
branch: master
Commits on Feb 19, 2012
  1. nonce_count fix

    authored
  2. digest_user and digest_pass

    authored
Commits on Feb 18, 2012
Commits on Feb 17, 2012
  1. @dangra

    Merge pull request #90 from kalessin/master

    dangra authored
    identify autothrottle debug mode stats with slot key, in order to allow to track concurrency/delay issues with spiders which crawls more than one site.
  2. @kalessin

    identify autothrottle debug mode stats with slot key, in order to all…

    kalessin authored
    …ow to
    
    track concurrency/delay issues with spiders which crawls more than one
    site.
Commits on Feb 16, 2012
  1. @pablohoffman
  2. @pablohoffman
Commits on Feb 11, 2012
  1. @pablohoffman
Commits on Feb 7, 2012
  1. @dangra
Commits on Jan 27, 2012
  1. @dangra
Commits on Jan 25, 2012
  1. @dangra

    Merge branch 'issue82'

    dangra authored
  2. @dangra
  3. @dangra
Commits on Jan 16, 2012
  1. @pablohoffman

    Merge pull request #80 from kalessin/master

    pablohoffman authored
    autothrottle code improvements (download delay + style)
  2. @kalessin
  3. @kalessin

    allow to set minimal download delay for autothrottle extension. also

    kalessin authored
    limit download delay to a minimal of spider.download_delay if given
  4. @pablohoffman

    Merge pull request #79 from seriyps/master

    pablohoffman authored
    ~10x speed-up for libxml2 XPathSelector
Commits on Jan 14, 2012
  1. @seriyps

    Speed-up libxml2 XPathSelector

    seriyps authored
Commits on Jan 13, 2012
  1. @pablohoffman
Commits on Jan 12, 2012
  1. @pablohoffman
  2. @pablohoffman

    scrapyd: fixed issue with ubuntu package: /var/lib/scrapyd/items dir …

    pablohoffman authored
    …not being created by default
Commits on Jan 5, 2012
  1. @pablohoffman
  2. @pablohoffman
  3. @pablohoffman
Commits on Jan 4, 2012
  1. @pablohoffman

    scrapyd: removed redundant .scrapy component from paths when using sc…

    pablohoffman authored
    …rapyd in 'scrapy server' mode
  2. @pablohoffman

    scrapyd: added support for storing items by default

    pablohoffman authored
    Items are stored the same way as logs, in jsonlines format.
    
    Also renamed logs_to_keep setting to jobs_to_keep.
  3. @pablohoffman
  4. @pablohoffman
  5. @pablohoffman
Commits on Jan 3, 2012
  1. @pablohoffman

    SitemapSpider: added support for sitemap urls ending in .xml and .xml…

    pablohoffman authored
    ….gz, even if they have a wrong content type
Commits on Jan 2, 2012
  1. @pablohoffman
  2. @pablohoffman

    bumped version to 0.15.1, mainly to avoid package upgrade issues with…

    pablohoffman authored
    … new versioning based on git describe
  3. @pablohoffman
Commits on Jan 1, 2012
  1. @pablohoffman

    Merge pull request #75 from darkrho/httpcache-stats

    pablohoffman authored
    tests: fixed httpcache testcase.
Commits on Dec 31, 2011
  1. @darkrho
Something went wrong with that request. Please try again.