Skip to content

Change external link (for robots.txt parser comparison) in docs to a more lasting page #5414

@anubhavp28

Description

@anubhavp28

Scrapy documentation (at the end of this section) links to a blog that contains performance numbers for different robots.txt parser backends. It would be better to change the link to point to this issue as it is more lasting. Currently, we are linking to a personal blog website which might disappear if the blog owner decides to change the hosting or blog name.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions