Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
branch: master
Commits on Apr 10, 2011
Commits on Jan 31, 2011
  1. @knu
  2. @knu

    Version bump to 0.0.7

    knu authored
  3. @knu

    Use sort_by.

    knu authored
  4. @knu

    The parser does not require 'uri'.

    knu authored
Commits on Jan 30, 2011
  1. @knu
  2. @knu
  3. @knu
Commits on Jan 23, 2011
  1. @knu

    NFC: Rename blocks to records.

    knu authored
Commits on Jan 8, 2011
  1. @knu
  2. @knu

    Version bump to 0.0.6

    knu authored
  3. @knu
  4. @knu
  5. @knu
  6. @knu

    Version bump to 0.0.5

    knu authored
  7. @knu
  8. @knu

    Correct handling of 404 error.

    knu authored
  9. @knu
  10. @knu

    Version bump to 0.0.4

    knu authored
  11. @knu

    Allow an empty value.

    knu authored
  12. @knu

    Add a test case for Crawl-Delay.

    knu authored
  13. @knu

    Treat a lonely % as a literal %.

    knu authored
  14. @knu
Commits on Jan 4, 2011
  1. @knu
  2. @knu

    Version bump to 0.0.3

    knu authored
  3. @knu

    Add methods to handle the <meta name="robots"> tag to Nokogiri::HTML:…

    knu authored
    …:Document.
    
    - meta_robots
    - noindex?
    - nofollow?
    
    Nokogiri is not pre-loaded, but only auto-loaded as necessary.
  4. @knu

    Uncomment a due test.

    knu authored
Commits on Jan 3, 2011
  1. @knu
  2. @knu

    Show an example.

    knu authored
  3. @knu
  4. @knu

    Version bump to 0.0.2

    knu authored
  5. @knu

    I prefer 2-clause BSDL.

    knu authored
  6. @knu
  7. @knu

    Version bump to 0.0.1

    knu authored
Something went wrong with that request. Please try again.