public
Clone URL: git://github.com/robbyrussell/rubyurl.git
Search Repo:
Robby Russell (author)
Sun Mar 02 17:43:00 -0800 2008
commit  f7fd211defe7227b53aa0ac6a05a0894b588ae0e
tree    2df056fa762f97565403149e910ae39c1dcf15a6
parent  ecbc90102fe92306a6bd5a8880e5fe952c558682
rubyurl / public / robots.txt
100644 8 lines (8 sloc) 0.119 kb
1
2
3
4
5
6
7
8
User-agent: *
Disallow: /
User-agent: Googlebot
Disallow: *
Allow: /about
Allow: /api
Allow: /report-abuse
Allow: /home