Permalink
Cannot retrieve contributors at this time
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
21 lines (21 sloc)
769 Bytes
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #This is a file retrieved by webwalkers a.k.a. spiders that | |
| #conform to a defacto standard. | |
| # See <URL:"http://web.nexor.co.uk/mak/doc/robots/norobots.html"> | |
| # | |
| #The webmaster for this site is Oliver Kelkar <kelkar@iao.fhg.de> | |
| # | |
| #Format is: | |
| # User-agent: <name of spider> | |
| # Disallow: <nothing> | <path> | |
| # Flag Date By Reason | |
| # $l1- 950130 epc finally understood what the file was for! | |
| # | |
| #----------------------------------------------------------------------------- | |
| # ROBOTS.TXT fuer http://www.mz.iao.fhg.de | |
| # | |
| # Oliver Kelkar <Oliver.Kelkar@iao.fhg.de>, 3/96 | |
| #----------------------------------------------------------------------------- | |
| # following prevents access to /misc/ for spiders | |
| User-Agent: * | |
| Disallow: /image | |
| Disallow: /button |