Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP
Job scheduler for load regulation
Erlang
Pull request Compare This branch is 33 commits behind uwiger:master.

Fetching latest commit…

Cannot retrieve the latest commit at this time

Failed to load latest commit information.
doc
examples
include
src
test
.gitignore
LICENSE
Makefile
NOTICE
README.md
TODO.org
rebar.config

README.md

jobs - a Job scheduler for load regulation

Copyright (c) 2010 Erlang Solutions Ltd.

Version: 0.1

JOBS

Jobs is a job scheduler for load regulation of Erlang applications. It provides a queueing framework where each queue can be configured for throughput rate, credit pool and feedback compensation. Queues can be added and modified at runtime, and customizable "samplers" propagate load status across all nodes in the system.

Specifically, jobs provides three features:

  • Job scheduling: A job is scheduled according to certain constraints.
    For instance, you may want to define that no more than 9 jobs of a
    certain type can execute simultaneously and the maximal rate at
    which you can start such jobs are 300 per second.
  • Job queueing: When load is higher than the scheduling limits
    additional jobs are queued by the system to be run later when load
    clears. Certain rules govern queues: are they dequeued in FIFO or
    LIFO order? How many jobs can the queue take before it is full? Is
    there a deadline after which jobs should be rejected. When we hit
    the queue limits we reject the job. This provides a feedback
    mechanism on the client of the queue so you can take action.
  • Sampling and dampening: Periodic samples of the Erlang VM can
    provide information about the health of the system in general. If we
    have high CPU load or high memory usage, we apply dampening to the
    scheduling rules: we may lower the concurrency count or the rate at
    which we execute jobs. When the health problem clears, we remove the
    dampener and run at full speed again.

Examples

To be done

Prerequisites

This application requires 'exprecs'. The 'exprecs' module is part of http://github.com/esl/parse_trans

Contribute

For issues, comments or feedback please create an issue!

Modules

jobs
jobs_app
jobs_info
jobs_lib
jobs_queue
jobs_queue_list
jobs_sampler
jobs_sampler_cpu
jobs_sampler_history
jobs_sampler_mnesia
jobs_server
Something went wrong with that request. Please try again.