bottlecaplabs / zombieurl fork watch download tarball
public
Description: I eat URLs. RAWRRRRR!
Clone URL: git://github.com/bottlecaplabs/zombieurl.git
Search Repo: 
removing robots.txt per andy
Greg Borenstein (author)
Fri Apr 18 19:52:23 -0700 2008
commit  ea6cecadc56cad408838a2249696fb37c7e1882c
tree    4c3dab09277fb6f967d9711691c83c98265bf534
parent  c452ee0fc3eaa2753de23e19f693f9c2eba40937
0
public/robots.txt 
...
1
2
3
4
5
6
7
8
 
...
 
 
 
 
 
 
 
 
 
0
@@ -1,9 +1 @@
0
-User-agent: *
0
-Disallow: /
0
-User-agent: Googlebot
0
-Disallow: *
0
-Allow: /about
0
-Allow: /api
0
-Allow: /report-abuse
0
-Allow: /home

Comments