Skip to content
This repository
Browse code

Merge pull request #6268 from carlesso/master

In robots.txt User-agent should be all downcase except for the first 'U'
  • Loading branch information...
commit fe3b742bd6cd20d7c4f1196797e16568edbd1e77 2 parents 9b4514c + 1abf156
José Valim authored May 11, 2012
2  guides/code/getting_started/public/robots.txt
... ...
@@ -1,5 +1,5 @@
1 1
 # See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
2 2
 #
3 3
 # To ban all spiders from the entire site uncomment the next two lines:
4  
-# User-Agent: *
  4
+# User-agent: *
5 5
 # Disallow: /
2  railties/lib/rails/generators/rails/app/templates/public/robots.txt
... ...
@@ -1,5 +1,5 @@
1 1
 # See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
2 2
 #
3 3
 # To ban all spiders from the entire site uncomment the next two lines:
4  
-# User-Agent: *
  4
+# User-agent: *
5 5
 # Disallow: /

0 notes on commit fe3b742

Please sign in to comment.
Something went wrong with that request. Please try again.