A Python Kestrel library

This is a simple client library for the kestrel queue system. It supports the entire documented protocol.

This library extends the Client class in the python-memcached library to add support for the non-memcache calls that kestrel supports like: config, reload, and shutdown.

WARNING!!!

You should only send strings through to the queue, if not the python-memcached library will serialize these objects and since kestrel ignores the flags supplied during a set operation, when the object is retrieved from the queue it will not be unserialized.

Examples

Adding an job to the queue:

import kestrel

q = kestrel.Client(servers=['127.0.0.1:22133'], queue='test_queue')
q.add('some test job')
q.close() # disconnect the client

Read a job from the queue:

job = q.get()

Peek at the next job in line:

job = q.peek()

Reliably read a set of jobs from the queue:

while True:
    job = q.next(timeout=10) # marks the last job as complete and gets a new one, also waits 10 seconds if no jobs are currently in the queue
    if job is not None:
        try:
            #process job
        except:
            q.abort() # mark the job as failed.

q.finish() # mark the last job a complete