Permalink
Commits on Jul 7, 2018
  1. Revert Googlebot UA to avoid breaking reddit crawls

    ivan committed Jul 7, 2018
    With Googlebot in the UA, reddit says:
    
    429 Too Many Requests https://www.reddit.com/...
Commits on Jun 25, 2018
  1. README: mention updated UA

    ivan committed Jun 25, 2018
  2. Bump Firefox version in UA string and add Googlebot to UA to archive …

    ivan committed Jun 25, 2018
    …tumblr blogs from Europe without GDPR cookie
Commits on May 25, 2018
Commits on May 24, 2018
Commits on May 19, 2018
Commits on May 15, 2018
  1. README: Python 3.4.7 -> 3.4.8

    ivan committed May 15, 2018
Commits on May 6, 2018
Commits on May 5, 2018
Commits on Apr 12, 2018
Commits on Apr 8, 2018
  1. Bump UA lie to Firefox 59

    ivan committed Apr 8, 2018
Commits on Mar 6, 2018
  1. Lock tornado version to 4.5.3 to avoid 5.0, which breaks with:

    ivan committed Mar 6, 2018
      File "[...]/lib/python3.4/site-packages/wpull/abstract/client.py", line 9, in <module>
        from wpull.connection import ConnectionPool
      File "[...]/lib/python3.4/site-packages/wpull/connection.py", line 11, in <module>
        from tornado.netutil import SSLCertificateError
    ImportError: cannot import name 'SSLCertificateError'
Commits on Dec 27, 2017
  1. README: adjust logo size

    ivan committed Dec 27, 2017
Commits on Dec 14, 2017
  1. extra_docs/pause_resume_grab_sites.sh: only resume grab-sites if we p…

    ivan committed Dec 14, 2017
    …aused the grab-sites
Commits on Dec 13, 2017
  1. README: thank BrowserStack

    ivan committed Dec 13, 2017
  2. reddit igset: ignore out.reddit.com; appears to be safe to ignore bec…

    ivan committed Dec 13, 2017
    …ause the tracking links are redundant with the non-tracking links
Commits on Dec 12, 2017
  1. global igset: ignore another /search.*updated-(min|max)= pattern on b…

    ivan committed Dec 12, 2017
    …logspot:
    
    *.blogspot.com/search?q=QUERY&updated-max=2011-08-23T15:10:00-07:00&max-results=20&start=79&by-date=true
  2. global igset: ignore 16x16 tumblr avatars with .pnj extension (typo-p…

    ivan committed Dec 12, 2017
    …rone tumblr programmer?)
Commits on Dec 11, 2017
Commits on Dec 7, 2017
  1. dashboard: for Chrome 63+, use the faster `overscroll-behavior: conta…

    ivan committed Dec 7, 2017
    …in` instead of attaching an onwheel event.
  2. README: switch from PPA-based python3.4 install to pyenv-based instal…

    ivan committed Dec 7, 2017
    …l; add install steps for Debian 9 and 10
Commits on Nov 22, 2017
  1. README: link to wpull v1.2.3

    ivan committed Nov 22, 2017