Job-centric stats for resque
Ruby HTML Other
Latest commit bd95e19 Oct 25, 2016 @lukeasrodgers lukeasrodgers Entry in CHANGELOG for example app.
[ci skip]
Failed to load latest commit information.
Gemfiles Fix CI builds on travis. Oct 18, 2016
docs/images Convert README to markdown, and add screenshots. Oct 24, 2016
examples/sinatra Add example app to display failure/success stats. Oct 26, 2016
lib Version bump 0.4.2 Oct 20, 2016
test Add stats for job histories Oct 20, 2016
.gitignore Ignore redis dump.rdb files. Oct 26, 2016
.travis.yml Fix CI builds on travis. Oct 18, 2016
Gemfile Modernize gemspec, Gemfile, etc. Oct 18, 2016
LICENSE.txt Use my proper name, add gem description. Jul 9, 2011 Convert README to markdown, and add screenshots. Oct 24, 2016
resque-job-stats.gemspec Convert README to markdown, and add screenshots. Oct 24, 2016


Build Status

Job centric stats for Resque.

Stats are tracked per Job type (class/module) in addition to the worker based stats Resque provides.

Stats tracked are:

  • Jobs performed
  • Jobs enqueued
  • Jobs failed
  • Duration of last x jobs completed
  • Average job duration over last 100 jobs completed
  • Longest job duration over last 100 jobs completed
  • Jobs enqueued as timeseries data (minute, hourly)
  • Jobs performed as timeseries data (minute, hourly)

This information can be used to help track performance and diagnose specific bottlenecks.

We are sending this information to Nagios for graphing and alerts (via a custom rake task).


Requires resque '~> 1.17.0'

In your Gemfile add:

gem 'resque-job-stats'


Simply extend your class

class MyJob
  extend Resque::Plugins::JobStats

  @queue = :my_job
  def self.perform(*args)
    # ..

And you will have a set of keys starting with 'stats:jobs:my_job' inside your Resque redis namespace.

Alternatively you can include just the metric you wish to record.

class MyVerboseJob
  extend Resque::Plugins::JobStats::Performed
  extend Resque::Plugins::JobStats::Enqueued
  extend Resque::Plugins::JobStats::Failed
  extend Resque::Plugins::JobStats::Duration
  extend Resque::Plugins::JobStats::Timeseries::Enqueued
  extend Resque::Plugins::JobStats::Timeseries::Performed

  @queue = :my_job
  def self.perform(*args)
    # ...

Duration module

The duration module provides two metrics, the longest job and the job rolling avg.

These are accessible via two singleton methods, MyJob.job_rolling_avg and MyJob.longest_job.

By default the last 100 jobs durations are stored and used to provide the above metrics.

You may set the number of jobs to include by setting the @durations_recorded variable.

class MyJob
  extend Resque::Plugins::JobStats::Duration

  @queue = :my_job
  @durations_recorded = 1000

  def self.perform(*payload)
    # ...

Timeseries module

The timeseries module provides timeseries counts of jobs performed. The metrics are rolling and kept for a period of time before being expired. The timestamp used for the timeseries data is UTC.

Resque Web Tab

The Resque web page for showing the statistics will only display jobs that extend Resque::Plugins::JobStats (in other words, just the jobs that include all of the metrics):

class MyJob
  extend Resque::Plugins::JobStats

The interface can be included in your app like this:

require 'resque-job-stats/server'

If you wish to display only certain metrics, you can filter the metrics accordingly. The default metrics can be found in Resque::Plugins::JobStats::Statistic.

  Resque::Server.job_stats_to_display = [:jobs_enqueued, :job_rolling_avg]



overview stats

Individual Job Histories

individual stats


  • Find clean way to add queue wait time stats.

Contributing to resque-job-stats

  • Check out the latest master to make sure the feature hasn't been implemented or the bug hasn't been fixed yet
  • Check out the issue tracker to make sure someone already hasn't requested it and/or contributed it
  • Fork the project
  • Start a feature/bugfix branch
  • Commit and push until you are happy with your contribution
  • Make sure to add tests for it. This is important so I don't break it in a future version unintentionally.
  • Please try not to mess with the Rakefile, version, or history. If you want to have your own version, or is otherwise necessary, that is fine, but please isolate to its own commit so I can cherry-pick around it.



Copyright (c) 2011-2012 Alan Peabody. See LICENSE.txt for further details.