Skip to content

pepijndevos/pypredis

master
Switch branches/tags
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 
 
 
 
 

A heavy-duty Redis library

A Redis library that connects to multiple instances over a unix socket and streams commands to them. The main use-case for this is high-throughput sharded data.

Redis-py has a blocking API with batched pipelines. All queries will be saved on the client, until you execute the pipeline. Then it sends all messages and waits for all responses.

pl1.execute()
pl2.execute()
pl3.execute()
pl4.execute()

This results in CPU spikes on single instances, and prevents efficient multicore utilisation.

txRedis would allow non-blocking pipelining, but due to its single-threaded nature is not suitable for CPU-intensive work.

PypRedis uses an API based on futures, and works by running your commands on a non-blocking IO thread. This allows you to pipeline in any way you want, attach callbacks, or block on the result.

PypRedis works on PyPy and uses the Hiredis parser.

Very alpha. No support for TCP/IP or Python 3. Patches welcome.

Usage

Currently quite low-level.

In [1]: import pypredis.client
In [2]: c = pypredis.client.UnixConnection('/tmp/redis.sock')
In [3]: e = pypredis.client.EventLoop()
In [4]: e.start()
In [6]: e.send_command(c, "SET", "A", "B").result()
Out[6]: 'OK'
In [7]: e.send_command(c, "SET", "B", "C").result()
Out[7]: 'OK'
In [8]: e.send_command(c, "MGET", "A", "B").result()
Out[8]: ['B', 'C']

About

A havy-duty Redis library

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published