Skip to content

Check permanent redirects #953

Closed
Closed
@honzajavorek

Description

@honzajavorek

This is more of a suggestion or an idea for future, and a #944 spin-off. We already check links. Sometimes the target changes and we link through unnecessary redirects. There are several types of redirects, but it boils down to:

  • Temporary redirects,
  • permanent redirects, when the content moves.

In case of the permanent ones, we can just update our links so they point to new places, saving readers' time and unnecessary hops, and also lowering the chance that the link breaks completely.

I think it's okay to check permanent redirects only from time to time, as a matter of regular seasonal gardening, rather than having the check under each PR.

As @TC-MO pointed out, this could be done by disallowing HTTP status codes for permanent redirects in Lychee configuration. I'm creating this issue as a note for myself that I want to do this locally and send a PR with updated links.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request.t-academyIssues related to Web Scraping and Apify academies.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions