* The yokels at Microsoft are using a bogus TLD for their MSN spider.

interchange · Sep 21, 2007 · 16be811 · 16be811
1 parent 33b1b3a
commit 16be811
Showing 1 changed file with 1 addition and 0 deletions.
diff --git a/dist/robots.cfg b/dist/robots.cfg
@@ -176,6 +176,7 @@ RobotHost <<EOR
     *.inktomisearch.com,
     *.lycos.com,
     *.pa-x.dec.com,
+    *.phx.gbl,
     add-url.altavista.com,
     msnbot.msn.com,
     westinghouse-rsl-com-usa.NorthRoyalton.cw.net,