Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unhelpful log message from core.downloader.handlers.http11 #2927

Closed
djunzu opened this issue Sep 17, 2017 · 4 comments
Closed

Unhelpful log message from core.downloader.handlers.http11 #2927

djunzu opened this issue Sep 17, 2017 · 4 comments

Comments

@djunzu
Copy link
Contributor

@djunzu djunzu commented Sep 17, 2017

Consider the two log messages:

2017-09-17 10:52:27 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (42276161) larger than download warn size (33554432).
2017-09-17 10:54:18 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request <GET https://example.com>.

While the second one can be useful, the first one is not helpful at all because there is no info about which request it is about. The first message should indicate the request it refers to in the same way the second message does.

@NoExitTV
Copy link
Contributor

@NoExitTV NoExitTV commented Oct 4, 2017

Can I have the code you used to get these error messages?

@djunzu
Copy link
Contributor Author

@djunzu djunzu commented Oct 5, 2017

Can I have the code you used to get these error messages?

@NoExitTV, sorry, but I can not disclose this project's source.

I could try to give you a url that generates this message... But I don't know which url generated it in the first place, and that is the issue! But I am guessing it was generated by a .m4v file (see #2928).

@NoExitTV
Copy link
Contributor

@NoExitTV NoExitTV commented Oct 6, 2017

@djunzu No worries. I figured it out as you've seen in my PR #2952

@kmike
Copy link
Member

@kmike kmike commented Oct 26, 2017

Fixed by #2952 - thanks @NoExitTV and @djunzu!

@kmike kmike closed this Oct 26, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
3 participants
You can’t perform that action at this time.