Skip to content

v1.5.1
Compare
Choose a tag to compare
@hcoura hcoura released this 22 May 00:05
· 82 commits to master since this release
v1.5.1
77a98eb
  • Remove username and password from settings since it's removed from crawlera.
  • Include affected spider in logs.
  • Handle situations when crawlera is restarted and reply with 407's for a few minutes
    by retrying the requests with a exponential backoff system.
Assets 2