You can clone with
HTTPS or Subversion.
Don't check to fetch /robots.txt when trying to fetch /robots.txt
Fix shadowing outer variable warning
Regenerate gemspec for version 0.0.7
Version bump to 0.0.7
The parser does not require 'uri'.
Clear the token queue after a parse is done.
Our parser is not thread-safe, so wrap it around a mutex block.
Fix a matching rule for known tokens in that it performed prefix matc…
NFC: Rename blocks to records.
Regenerate gemspec for version 0.0.6
Version bump to 0.0.6
Revamp error handling and cache manipulation.
Add more test cases to earn coverage.
Regenerate gemspec for version 0.0.5
Version bump to 0.0.5
Add a test for a lonely percent sign.
Correct handling of 404 error.
Regenerate gemspec for version 0.0.4
Version bump to 0.0.4
Allow an empty value.
Add a test case for Crawl-Delay.
Treat a lonely % as a literal %.
Properly deal with percent encoding according to the RFC draft.
Regenerate gemspec for version 0.0.3
Version bump to 0.0.3
Add methods to handle the <meta name="robots"> tag to Nokogiri::HTML:…
Nokogiri is not pre-loaded, but only auto-loaded as necessary.
Uncomment a due test.
Add racc as development dependency.
Show an example.
Regenerate gemspec for version 0.0.2
Version bump to 0.0.2
I prefer 2-clause BSDL.
Regenerate gemspec for version 0.0.1
Version bump to 0.0.1