cell - Actor framework
What is an Actor
An Actor is an entity (a class in cell), that has a mailbox and a behaviour. Actors communicate between each other only by exchanging messages. Upon receiving a message, the behaviour of the actor is executed, upon which the actor can send a number of messages to other actors, create a number of actors or change its internal state.
- distributed actors (actors are started on celery workers)
- Remoting: Communicating with actors running on other hosts
- Routers: it supports round-robin, direct and broadcast delivery of actor messages. You can create custom routers on top of it, implementing Actors as routers (joiner, collector, gatherer).
Why should I use it?
In a nutshell:
- Horizontal scalability with actors across multiple nodes
- You get asynchronous message passing for free
- If you are already using celery, all comes for free, no additional setup is required
- Control over the tasks distribution
- More flexible configurations of nodes
- Well known abstraction
- Easy learning curve (check teh 30 sec video to get you started)
if you are a celery user:
- You can use Actors, instead of task-based classes:
(You can program with classes and not tasks)
- Stateful execution. You can link actors together and their execution, creating complex workflows.
You can control the execution per actor/not per worker.
- Better control over work distribution (You can target the same worker for a given task):
adder.send.add(2, 2) adder.send.add(2, 2)
If you are a general Pythonist
Having a framework for distributed actor management in your toolbox is a must, bacause:
- simplify the distributed processing of tasks.
- vertical scalability:
- Fair work distribution, load balancing, sticky routing
You can install cell either via the Python Package Index (PyPI) or from source.
To install using pip,:
$ pip install cell
To install using easy_install,:
$ easy_install cell
If you have downloaded a source tarball you can install it by doing the following,:
$ python setup.py build # python setup.py install # as root
If you are too impatient to start, here are the 3 quick steps you need to run 'Hello, world!' in cell: (You can also check the Demo video)
- Define an Actor
from cell.actors import Actor class GreetingActor(Actor): class state: def greet(self, who='world'): print 'Hello %s' % who
- Start celery with an amqp broker support
>>> celery worker -b 'pyamqp://guest@localhost'
- Invoke a method on an actor instance:
from cell.agents import dAgent from kombu import Connection from examples.greeting import GreetingActor connection = Connection('amqp://guest:guest@localhost:5672//') agent = dAgent(connection) greeter = agent.spawn(GreetingActor) greeter.call('greet')
Join the carrot-users mailing list.
If you have any suggestions, bug reports or annoyances please report them to our issue tracker at http://github.com/celery/cell/issues/
Development of cell happens at Github: http://github.com/celery/cell
You are highly encouraged to participate in the development. If you don't like Github (for some reason) you're welcome to send regular patches.
This software is licensed under the New BSD License. See the LICENSE file in the top distribution directory for the full license text.
Copyright (C) 2011-2013 GoPivotal, Inc.