pyermc is a memcache client library with support for "pluggable" driver backends.
Current backends include a text protocol driver (default), a binary protocol driver, and a wrapped ultramemcached driver.
While pyermc is somewhat compatible with python-memcached, full compatibility is not a design goal.
pyermc supports connecting to a single memcached instance (or server that speaks the memcached protocol). If you require multiple servers, consistent hashing, etc, then it is recommended to use twemproxy or similar.
pyermc exposes connectivity faults, via exceptions, to the calling code. This
is in contrast to python-memcached, which simply enters an 'ignore backend'
state. Exposing underlying faults is often needed when working with queueing
servers that support the memcache driver (such as kestrel and
darner), as well as translation proxies like couchbase's moxie. If
the old behavior is desired, there is an optional
that may be set as part of client creation.
pyermc is currently tested against python2.7.
- pickle support
- gevent/eventlet compatible (ultramemcache backend uses python socket too)
- uses lz4 for compression instead of gzip (fast)
- selectable backend drivers
- ultramemcache (optional, required only for ultramemcache backend)
Current backends are:
This is the default backend, and speaks the memcache text protocol.
Speaks the memcache binary protocol.
Wraps the umemcache client.
>>> import pyermc # create client and connect # note that the client_driver listed here is also the default. # added to example just to show how to specify a driver manually >>> c = pyermc.Client( ... host='127.0.0.1', ... port=11211, ... disable_nagle=True, ... cache_cas=True, ... client_driver=pyermc.driver.textproto.TextProtoDriver) # calling connect is option. if omitted, the client will connect # during first request. >>> c.connect() # example set/get >>> c.set('test', 'test string') True >>> c.get('test') 'test string' # incr/decr example >>> c.set("something", "1") # memcached requires val used for incr/decr be a string True >>> c.incr("something") 2 >>> c.incr("something") 3 >>> c.decr("something") 2 >>> c.delete("something") True # check-and-set (cas) example >>> c.set("testcas", 1) True # when client is created with cache_cas=True, the cas id in a gets # response is stored internally. >>> c.gets("testcas") 1 # this worked! it wasn't modified since. >>> c.cas("testcas", 21) True # As expected, this fails, the previous line modified the value on the # server and since we have the previous cas_id stored inside the client, it # fails. >>> c.cas("testcas", 21) False # you can manually clear all cached cas values # c.reset_cas() # add example >>> c.add("testadd", "a") True >>> c.get("testadd") 'a' # add only succeeds when the key is not already present in the server >>> c.add("testadd", "b") False # test replace # this only works if there is already a key on the server >>> c.replace("testreplace", "c") False >>> c.set("testreplace", "yes") True >>> c.get("testreplace") 'yes' >>> c.replace("testreplace", "no") True >>> c.get("testreplace") 'no' # test append (prepend also works as you would expect) >>> c.set("foo", "a") True >>> c.append("foo", "b") True >>> c.append("foo", "c") True >>> c.get("foo") 'abc'
To run the benchmark script, you will need to install python-memcached. A
running memcached instance is also required (localhost, port 5555, and make
sure no other valuable data is housed there, as the benchmark performs a
flush_all at various stages).
To run the benchmarks:
memcached -l 127.0.0.1 -p 55555 & PYTHONPATH="." python benchmarks/bench.py fg ^C
Similar to benchmarks, a memcached instance running on localhost and port 55555
is needed. If not present, integration tests will be skipped. The tests perform
flush_all at various stages, so ensure no valuable data is stored in the test
nose is recommended.
mock is required.
If you are running python2.6, then
unittest2 is also required, as we use some
python2.7 specific unit test methods.
To run the tests:
memcached -l 127.0.0.1 -p 55555 & nosetests fg ^C