The semalt.com crawler is a bit shady and, if nothing else, pollutes your logs with hits and doesn't respect robots.txt. This gem makes it simple to block semalt.com's crawler.
Add this line to your application's Gemfile:
gem 'rack-block-semalt'
And then execute:
$ bundle
Or install it yourself as:
$ gem install rack-block-semalt
Simply add these two lines of code to your config.ru file:
require 'rack-block-semalt'
use Rack::BlockSemalt
- Fork it
- Create your feature branch (
git checkout -b my-new-feature) - Commit your changes (
git commit -am 'Add some feature') - Push to the branch (
git push origin my-new-feature) - Create a new pull request