Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[idea] Add some non-standard but commonly used HTTP status codes for retrying #2851

Closed
starrify opened this issue Jul 26, 2017 · 2 comments
Closed

Comments

@starrify
Copy link
Contributor

@starrify starrify commented Jul 26, 2017

Cloudflare is being used widely, which has has introduced its non-standard HTTP status codes. E.g.

In practice, I've seen several occurrences of 522 and/or 524 status codes generated by Cloudflare. Usually a user may simply override setting RETRY_HTTP_CODES to include these values.
Here I suppose it might be good to include these two codes into scrapy.settings.default_settings.RETRY_HTTP_CODES.

See also:

@redapple
Copy link
Contributor

@redapple redapple commented Jul 26, 2017

Sounds fine @starrify

@dangra
Copy link
Member

@dangra dangra commented Jul 26, 2017

fixed by #2852

@dangra dangra closed this Jul 26, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
3 participants