Skip to content
Commits on Apr 9, 2012
  1. Forgot to merge URL's before checking if there's an image or internal…

    automatedtendencies committed Apr 9, 2012
    …. All relative URL's weren't marked as internal and disregarded such as '/info/here.html'.
Commits on Apr 1, 2012
  1. Removed debug puts from crawler

    automatedtendencies committed Apr 1, 2012
  2. Fixed README

    automatedtendencies committed Apr 1, 2012
  3. Fixed readme for syntax

    automatedtendencies committed Apr 1, 2012
  4. Fixed readme for syntax

    automatedtendencies committed Apr 1, 2012
  5. Fixed readme for syntax

    automatedtendencies committed Apr 1, 2012
  6. Added proxy list options to initializer for crawler use.

    automatedtendencies committed Apr 1, 2012
Commits on Nov 29, 2011
  1. @dchuk

    finally fixed damn max_urls issue

    dchuk committed Nov 29, 2011
  2. @dchuk

    fixed the max_urls to actually work, added redirection support to typ…

    dchuk committed Nov 29, 2011
    …heous (thanks jake)
  3. @dchuk
Commits on Nov 27, 2011
  1. @dchuk

    bumped version number

    dchuk committed Nov 27, 2011
  2. @dchuk

    Merge pull request #1 from JakeAustwick/master

    dchuk committed Nov 27, 2011
    Image extension enhancement and README fix
  3. Fixed syntax error in README

    Jake Auswick committed Nov 27, 2011
  4. Convert image extensions to lower case before checking

    Jake Auswick committed Nov 27, 2011
Commits on Nov 23, 2011
  1. @dchuk
Commits on Nov 12, 2011
  1. @dchuk

    tweaked gemspec description

    dchuk committed Nov 12, 2011
  2. @dchuk

    readme stuff

    dchuk committed Nov 12, 2011
  3. @dchuk
  4. @dchuk

    fixed heading

    dchuk committed Nov 11, 2011
  5. @dchuk

    fixed installation instructions

    dchuk committed Nov 11, 2011
  6. @dchuk

    fixed typo

    dchuk committed Nov 11, 2011
  7. @dchuk

    added option example to new method

    dchuk committed Nov 11, 2011
  8. @dchuk
  9. @dchuk
  10. @dchuk

    added gitignore

    dchuk committed Nov 11, 2011
  11. @dchuk

    fixed formatting

    dchuk committed Nov 11, 2011
  12. @dchuk

    fixed code

    dchuk committed Nov 11, 2011
  13. @dchuk

    fixed code formatting

    dchuk committed Nov 11, 2011
  14. @dchuk

    readme documentation

    dchuk committed Nov 11, 2011
Commits on Nov 11, 2011
  1. @dchuk

    fixing spider graphic

    dchuk committed Nov 11, 2011
  2. @dchuk

    changed to markdown

    dchuk committed Nov 11, 2011
  3. @dchuk

    readme

    dchuk committed Nov 11, 2011
  4. @dchuk
  5. @dchuk

    Initial commit

    dchuk committed Nov 11, 2011
Something went wrong with that request. Please try again.