Browse files

In robots.txt, User-agent should be all downcase except for the first…

  • Loading branch information...
1 parent 9b4514c commit 1abf15657b47b32dd5ba295bcdb618b41b46c0bc @carlesso carlesso committed May 11, 2012
View
2 guides/code/getting_started/public/robots.txt
@@ -1,5 +1,5 @@
# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
#
# To ban all spiders from the entire site uncomment the next two lines:
-# User-Agent: *
+# User-agent: *
# Disallow: /
View
2 railties/lib/rails/generators/rails/app/templates/public/robots.txt
@@ -1,5 +1,5 @@
# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
#
# To ban all spiders from the entire site uncomment the next two lines:
-# User-Agent: *
+# User-agent: *
# Disallow: /

0 comments on commit 1abf156

Please sign in to comment.