DOWNLOAD_WARNSIZE is too verbose #1303
Closed
Labels
Comments
@kmike once per run or per request ? |
@nramirezuy once per request. In this case it probably doesn't make sense to show how much more data is received because it will be only slightly larger than a limit. |
I agree, maybe change the message and show the request. |
A good idea to show a request. |
Fixed in #1654 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
When DOWNLOAD_WARNSIZE is set, there is no Content-Length header and warn limit is reached, Scrapy starts to issue WARNING log messages, a message per a couple of KBs downloaded:
I think the message should be issued only once.
The text was updated successfully, but these errors were encountered: