Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[idea] Add some non-standard but commonly used HTTP status codes for retrying #2851

Closed
starrify opened this issue Jul 26, 2017 · 2 comments
Closed

[idea] Add some non-standard but commonly used HTTP status codes for retrying #2851

starrify opened this issue Jul 26, 2017 · 2 comments

Comments

@starrify
Copy link
Contributor

Cloudflare is being used widely, which has has introduced its non-standard HTTP status codes. E.g.

In practice, I've seen several occurrences of 522 and/or 524 status codes generated by Cloudflare. Usually a user may simply override setting RETRY_HTTP_CODES to include these values.
Here I suppose it might be good to include these two codes into scrapy.settings.default_settings.RETRY_HTTP_CODES.

See also:
@redapple
Copy link
Contributor

Sounds fine @starrify

@starrify starrify mentioned this issue Jul 26, 2017
Merged
@dangra
Copy link
Member

dangra commented Jul 26, 2017

fixed by #2852

@dangra dangra closed this as completed Jul 26, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@dangra @starrify @redapple