Join GitHub today
GitHub is home to over 31 million developers working together to host and review code, manage projects, and build software together.Sign up
Meta Robots Tag
Meta robots are usually used to exclude pages from search results (via
noindex value). Slim SEO automatically checks if a page needs to be indexed and auto exclude it from the search results if necessary.
The following pages are excluded from search results:
- 404 page: because it doesn't provide any content.
- Search results pages: internal search results page should not be indexed for two reasons. First, the content are duplicated as the posts are already indexed. Second, there are unlimited search results page (for unlimited search queries) and that leads to low-quality and duplicated content.
- Private singular pages/posts: no one can see it but admins, including bots. So no need to index them.
- Empty content page: such as categories/tags that don't have any posts, or an author which don't have any posts.
- Feed: they're for feed readers, not for search results.