Block bad, possibly even malicious web crawlers (automated bots) using htaccess.
Switch branches/tags
Nothing to show
Clone or download
bluedragonz Merge pull request #8 from Firesphere/patch-1
Fix typo bad_bo && bad_bott
Latest commit 20e086f Feb 15, 2014
Failed to load latest commit information.
.htaccess Fix typo bad_bo && bad_bott Feb 14, 2014 Update Aug 31, 2013

Bad Bot Blocker

223 Apache htaccess rules to block bad bots.

Bad bots are defined as:

  • E-mail harvesters
  • Content scrapers
  • Spam bots
  • Vulnerability scanners
  • Aggressive bots that provide little value
  • Bots linked to viruses or malware
  • Government surveillance bots
  • Russian search engine Yandex
  • Chinese search engine Baidu


Unless your website is written in Russian or Chinese, you probably don't get any traffic from them. They mostly just waste bandwidth and consume resources.

Bots Are Liars

Bots try to make themselves look like other software by disguising their useragent. Their useragents may look harmless, perfectly legitimate even. For example, "^Java" but according to Project Honeypot, it's actually one of the most dangerous.


If you have a bizarre or complicated setup, be sure to look everything over before using it. But for anyone with something that resembles a standard Apache installation, this should work without any issues.