Skip to content


Subversion checkout URL

You can clone with
Download ZIP


Add infinite loop detection for badly written custom 404 responses #272

Zapotek opened this Issue · 1 comment

1 participant


The are broken custom 404 responses out there which use relative paths, so if, for example, this URL is requested:

They include something like:

<a href="sitemap">Sitemap</a>

As part of the standard menu.

However, when converted to absolute, that URL will become and cause yet another similar 404 response leading to an infinite loop.

The Spider needs to be updated in order to identify custom 404 pages and keep track of their relative links.

(cc @rbgCode)

@Zapotek Zapotek removed this from the v0.5 milestone

My idea wouldn't guarantee that the resulting path would be a 404, just that it's likely to.
So, gotta close this, I don't like messing with coverage based on heuristics.

@Zapotek Zapotek closed this
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Something went wrong with that request. Please try again.