Permalink
Commits on Apr 10, 2011
Commits on Jan 31, 2011
  1. Regenerate gemspec for version 0.0.7

    knu committed Jan 31, 2011
  2. Version bump to 0.0.7

    knu committed Jan 31, 2011
  3. Use sort_by.

    knu committed Jan 31, 2011
  4. The parser does not require 'uri'.

    knu committed Jan 31, 2011
Commits on Jan 30, 2011
Commits on Jan 23, 2011
  1. NFC: Rename blocks to records.

    knu committed Jan 23, 2011
Commits on Jan 8, 2011
  1. Version bump to 0.0.6

    knu committed Jan 8, 2011
  2. Version bump to 0.0.5

    knu committed Jan 8, 2011
  3. Correct handling of 404 error.

    knu committed Jan 8, 2011
  4. Version bump to 0.0.4

    knu committed Jan 8, 2011
  5. Allow an empty value.

    knu committed Jan 8, 2011
  6. Add a test case for Crawl-Delay.

    knu committed Jan 8, 2011
  7. Treat a lonely % as a literal %.

    knu committed Jan 8, 2011
Commits on Jan 4, 2011
  1. Version bump to 0.0.3

    knu committed Jan 4, 2011
  2. Add methods to handle the <meta name="robots"> tag to Nokogiri::HTML:…

    …:Document.
    
    - meta_robots
    - noindex?
    - nofollow?
    
    Nokogiri is not pre-loaded, but only auto-loaded as necessary.
    knu committed Jan 4, 2011
  3. Uncomment a due test.

    knu committed Jan 4, 2011
Commits on Jan 3, 2011
  1. Show an example.

    knu committed Jan 3, 2011
  2. Version bump to 0.0.2

    knu committed Jan 3, 2011
  3. I prefer 2-clause BSDL.

    knu committed Jan 3, 2011
  4. Version bump to 0.0.1

    knu committed Jan 3, 2011