Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.Sign up
We’ve had a few clients set a page to “not indexed”, only to find their page has still been indexed (either because it was indexed before they set “not indexed”, or because there are links pointing to it from other pages that are indexed). It’s excluded from the sitemap, but may still be crawled if it’s discovered another way.
IMO it makes sense to set