Browse files

Removing robots.txt from public as it seems to get picked up if you r…

…emove robots.txt from your Rails app which prevents you from being able to serve robots.txt using a Rails controller action
  • Loading branch information...
1 parent 77b4559 commit ac1646f78f5a36c9fcbbed6b8d251ec7fff039ea @jasonfox jasonfox committed Oct 5, 2011
Showing with 0 additions and 5 deletions.
  1. +0 −5 public/robots.txt
View
5 public/robots.txt
@@ -1,5 +0,0 @@
-# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
-#
-# To ban all spiders from the entire site uncomment the next two lines:
-# User-Agent: *
-# Disallow: /

0 comments on commit ac1646f

Please sign in to comment.