Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[idea] Add some non-standard but commonly used HTTP status codes for retrying #2851

starrify opened this issue Jul 26, 2017 · 2 comments


Copy link

Cloudflare is being used widely, which has has introduced its non-standard HTTP status codes. E.g.

In practice, I've seen several occurrences of 522 and/or 524 status codes generated by Cloudflare. Usually a user may simply override setting RETRY_HTTP_CODES to include these values.
Here I suppose it might be good to include these two codes into scrapy.settings.default_settings.RETRY_HTTP_CODES.

See also:

Copy link

Sounds fine @starrify

Copy link

dangra commented Jul 26, 2017

fixed by #2852

@dangra dangra closed this as completed Jul 26, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
None yet
None yet

No branches or pull requests

3 participants