Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Catching VerificationError warning in scrapy.core.downloader.tls #3573

Open
dkajtoch opened this issue Jan 10, 2019 · 0 comments
Open

Catching VerificationError warning in scrapy.core.downloader.tls #3573

dkajtoch opened this issue Jan 10, 2019 · 0 comments

Comments

@dkajtoch
Copy link

In the file: https://github.com/scrapy/scrapy/blob/master/scrapy/core/downloader/tls.py line 77. When scraping some website I am getting VerificationError (which is true - this website has broken certificate) which instead of being passed further is caught there and logged as a warning. Is there a chance to redesign the class somehow so that any warning (in general) is passed further, for example in response.meta? I don't want to close the connection if that error happens but I need to ascribe this info to the url.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants