Rack middleware that executes javascript before serving pages to crawlers.
Ruby JavaScript
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
example
lib
test
README.md
Rakefile
indexable.gemspec

README.md

Indexable

Drop-in Rack middleware that that executes javascript before serving pages to crawlers.

Installation

You will need to install PhantomJS. We use the network requst abort functionality that was added in version 1.9, so lower versions will not work. You can check the installed version of PhantomJS by running phantomjs -v.

Rails

Add this to your Gemfile:

gem 'indexable'

That's it, we're done!

Rack

require 'indexable'
use Indexable::Middleware

There is an example Rack application in the example/ directory.

Common

(Optional) Adding the following meta tag to the head section of your pages will opt you into the AJAX crawling scheme, which the middleware uses in addition to checking the user agent in order to determine whether a request is coming from a crawler.

<meta name="fragment" content="!">