This repository has been archived by the owner. It is now read-only.
Permalink
Newer
Older
100755 31 lines (28 sloc) 545 Bytes
1
User-agent: *
2
Disallow: /cgi-bin
3
Disallow: /wp-admin
4
Disallow: /wp-includes
5
Disallow: /wp-content/plugins
6
Disallow: /wp-content/cache
7
Disallow: /wp-content/themes
8
Disallow: /trackback
9
Disallow: /feed
10
Disallow: /comments
11
Disallow: /category/*/*
12
Disallow: */trackback
13
Disallow: */feed
14
Disallow: */comments
15
Disallow: /*?*
16
Disallow: /*?
17
Allow: /wp-content/uploads
18
19
# Google Image
20
User-agent: Googlebot-Image
21
Disallow:
22
Allow: /*
23
24
# Google AdSense
25
User-agent: Mediapartners-Google*
26
Disallow:
27
Allow: /*
28
29
# digg mirror
30
User-agent: duggmirror
Jan 4, 2012
31
Disallow: /