Skip to content
Permalink
Browse files

Add directions on how to disable robots.txt generation/warning

Signed-off-by: Chris Warrick <kwpolska@gmail.com>
  • Loading branch information
Kwpolska committed Jan 13, 2017
1 parent 83bdd93 commit 0e2f7b35a49cef1d5d2330a060658ccac4eb3804
Showing with 1 addition and 0 deletions.
  1. +1 −0 nikola/plugins/task/robots.py
@@ -60,6 +60,7 @@ def gen_tasks(self):
def write_robots():
if kw["site_url"] != urljoin(kw["site_url"], "/"):
utils.LOGGER.warn('robots.txt not ending up in server root, will be useless')
utils.LOGGER.info('Add "robots" to DISABLED_PLUGINS to disable this warning and robots.txt generation.')

with io.open(robots_path, 'w+', encoding='utf8') as outf:
outf.write("Sitemap: {0}\n\n".format(sitemapindex_url))

0 comments on commit 0e2f7b3

Please sign in to comment.
You can’t perform that action at this time.