python-zmq-message-patterns

Library to quickly build ZeroMQ based Python applications.

Introduction

Library to make writing applications using ZeroMQ message patterns through PyZMQ easier.

TODO: explain ZMessage and ZNode classes.

Install

Install through pip:

pip install zmq-message-patterns

Pipeline

A ventilator sends jobs to multiple worker processes, which send the results to a sink.

Channels:

• ventilator -> worker: jobs for the workers
• ventilator -> sink: IDs of jobs sent to workers, so sink knows if all jobs have completed
• worker -> sink: results
• sink -> worker: sink sends shutdown command, when finished

Diagram:

ventilator-------------+
    |                  |

+-------+------+ | | | | |

worker worker worker ... |

|| || || | ++------++----++ | || | sink----------------+

An is a fully functional example in the examples directory (examples/pipeline_example.py).