Support for detecting a soft 404 page. Likely needs very good heuristics or statistical analysis in order to be useful.