Arachnophobia is a .Net library designed to give you an easy way to add no-index spider
content to your ASP.Net site or IIS server with no fuss.
What is included
- An ASP.Net HttpHandler that responds to /robots.txt with a disallow * txt file
- An HttpModule that adds 'X-Robots-Tag' to all outgoing requests to tell spiders to not index individual files (see this Google post)
How to Install
###Website Installation - Download and install by hand*
Download the release zip from here
Place the Binary of your choice (debug or release) in your Bin folder
Add the HttpHandler and HttpModule to your sites web.config - An example is included in the download zip file including the necessary httphandler and httpmodule references.
###Server Installation - Download and install by hand*
###Site Installation - Nuget
###Server Installation - WebPI
Version 0.1 First release with both HttpHandler and HttpModule. No GAC support yet