Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP
Branch: master
Commits on Apr 24, 2015
Commits on Feb 6, 2015
  1. drop .current suffix logic

    authored
Commits on Jan 18, 2015
  1. update crawler readme

    authored
  2. drop reports

    authored
Commits on Jan 11, 2015
  1. fix append cron task

    authored
Commits on Jan 10, 2015
Commits on Jan 9, 2015
  1. sort entries by timestamp, break ties by ID

    authored
    ID order != timestamp order, which causes current file rotation logic to switch archives multiple times.
Commits on Jan 7, 2015
Commits on Jan 3, 2015
  1. update crawler cron tasks

    authored
    closes #79
Commits on Jan 2, 2015
  1. first cut at updated readme

    authored
Commits on Dec 31, 2014
  1. new BQ import logic

    authored
  2. continue polling on error

    authored
Commits on Dec 21, 2014
  1. bump gem dependencies

    authored
  2. update crawl logic

    authored
    - don't run parallel fetches (possible dupes)
    - fetch latest 100 items
    - log API rate limit status
  3. rename upstart process

    authored
Commits on Aug 3, 2014
  1. update dependecies

    authored
Commits on May 7, 2014
Commits on May 6, 2014
  1. Merge pull request #48 from benjojo/master

    authored
    Update event count from 18 to 23
  2. @benjojo

    Updated event type count from 18 to 23

    benjojo authored
    A very cosmetic change I do agree, but its nice to stay up to date on these things
Commits on Nov 5, 2013
  1. update cron tasks

    authored
Commits on Sep 28, 2013
  1. cleanup borked UTF-8

    authored
  2. increase polling frequency

    authored
Something went wrong with that request. Please try again.