Permalink
Switch branches/tags
Nothing to show
Commits on Apr 9, 2012
  1. Forgot to merge URL's before checking if there's an image or internal…

    automatedtendencies
    automatedtendencies committed Apr 9, 2012
    …. All relative URL's weren't marked as internal and disregarded such as '/info/here.html'.
Commits on Apr 1, 2012
  1. Removed debug puts from crawler

    automatedtendencies
    automatedtendencies committed Apr 1, 2012
  2. Fixed README

    automatedtendencies
    automatedtendencies committed Apr 1, 2012
  3. Fixed readme for syntax

    automatedtendencies
    automatedtendencies committed Apr 1, 2012
  4. Fixed readme for syntax

    automatedtendencies
    automatedtendencies committed Apr 1, 2012
  5. Fixed readme for syntax

    automatedtendencies
    automatedtendencies committed Apr 1, 2012
  6. Added proxy list options to initializer for crawler use.

    automatedtendencies
    automatedtendencies committed Apr 1, 2012
Commits on Nov 29, 2011
  1. fixed the max_urls to actually work, added redirection support to typ…

    dchuk committed Nov 29, 2011
    …heous (thanks jake)
Commits on Nov 27, 2011
  1. bumped version number

    dchuk committed Nov 27, 2011
  2. Merge pull request #1 from JakeAustwick/master

    dchuk committed Nov 27, 2011
    Image extension enhancement and README fix
  3. Fixed syntax error in README

    Jake Auswick
    Jake Auswick committed Nov 27, 2011
  4. Convert image extensions to lower case before checking

    Jake Auswick
    Jake Auswick committed Nov 27, 2011
Commits on Nov 23, 2011
Commits on Nov 12, 2011
  1. tweaked gemspec description

    dchuk committed Nov 12, 2011
  2. readme stuff

    dchuk committed Nov 12, 2011
  3. fixed heading

    dchuk committed Nov 12, 2011
  4. fixed installation instructions

    dchuk committed Nov 12, 2011
  5. fixed typo

    dchuk committed Nov 12, 2011
  6. added gitignore

    dchuk committed Nov 12, 2011
  7. fixed formatting

    dchuk committed Nov 12, 2011
  8. fixed code

    dchuk committed Nov 12, 2011
  9. fixed code formatting

    dchuk committed Nov 12, 2011
  10. readme documentation

    dchuk committed Nov 12, 2011
Commits on Nov 11, 2011
  1. fixing spider graphic

    dchuk committed Nov 11, 2011
  2. changed to markdown

    dchuk committed Nov 11, 2011
  3. readme

    dchuk committed Nov 11, 2011
  4. Initial commit

    dchuk committed Nov 11, 2011