Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reschedule checking of invalid links with HTTP status 429/529 #153

Closed
timobrembeck opened this issue Jan 15, 2023 · 1 comment · Fixed by #174
Closed

Reschedule checking of invalid links with HTTP status 429/529 #153

timobrembeck opened this issue Jan 15, 2023 · 1 comment · Fixed by #174

Comments

@timobrembeck
Copy link
Contributor

When links are invalid due to a server's rate limiting (usually denoted with HTTP status 429) or a temporary overload (unofficial standard seems to be 529), I think it would make sense to not update the (last) status of the link and keep last_checked unchanged. This way, the link can easier be checked again in the future even when EXTERNAL_RECHECK_INTERVAL has not yet passed.
Optionally, we could also re-schedule these tasks automatically as part of cron.py.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants