1.7.0
If you are upgrading from 1.6.x to 1.7.x please use the migration guide.
New feature(s):
- Request methods (scope option)
- Request timeout (performance option)
Improvement(s):
- Close all threads safely on SIGINT
- Run
crawler_after_finish
callback on SIGINT - Removed queue counting overhead
- Removed #anchors from URLs
Fixed bug(s):
- On request error message was an object