Permalink
Browse files

block robots by default

  • Loading branch information...
1 parent 1177442 commit 7492cb2f7c0fee3ed722ed010de5cd7d744577d1 @dleavitt dleavitt committed Oct 2, 2012
Showing with 2 additions and 2 deletions.
  1. +2 −2 public/robots.txt
View
4 public/robots.txt
@@ -1,5 +1,5 @@
# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
#
# To ban all spiders from the entire site uncomment the next two lines:
-# User-Agent: *
-# Disallow: /
+User-Agent: *
+Disallow: /

0 comments on commit 7492cb2

Please sign in to comment.