Skip to content

Commit

Permalink
Issue 2949: disallow indexing of external works
Browse files Browse the repository at this point in the history
  • Loading branch information
@CristinaRO
CristinaRO committed Mar 4, 2012
1 parent d3bef13 commit b2e82d4
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions public/robots.public.txt
View file
Original file line number Original file line Diff line number Diff line change
Expand Up @@ -8,6 +8,7 @@ User-agent: *
Disallow: /works? # cruel but efficient Disallow: /works? # cruel but efficient
Disallow: /autocomplete/ Disallow: /autocomplete/
Disallow: /downloads/ Disallow: /downloads/
Disallow: /external_works/
# disallow indexing of search results # disallow indexing of search results
Disallow: /bookmarks/search? Disallow: /bookmarks/search?
Disallow: /people/search? Disallow: /people/search?
Expand All @@ -17,6 +18,7 @@ Disallow: /works/search?
User-agent: Googlebot User-agent: Googlebot
Disallow: /autocomplete/ Disallow: /autocomplete/
Disallow: /downloads/ Disallow: /downloads/
Disallow: /external_works/
# Googlebot is smart and knows pattern matching # Googlebot is smart and knows pattern matching
Disallow: /works/*? Disallow: /works/*?
Disallow: /*search? Disallow: /*search?
Expand Down

0 comments on commit b2e82d4

Please sign in to comment.