Big download is not being cancelled properly #1616
I am running scrapy 1.0.1 in my pyhon web crawler and setting the max download size like this:
When I run into a bigger file, scrappy keeps logging the error:
Any thoughts on why this would happen ? It seems to be something wrong on twisted not cancelling the download.
Detailed version info:
The text was updated successfully, but these errors were encountered: