Skip to content

Commit

Permalink
Describe Execution Platform.
Browse files Browse the repository at this point in the history
  • Loading branch information
thedrow committed Jul 1, 2020
1 parent cdbeed6 commit 76731c8
Show file tree
Hide file tree
Showing 2 changed files with 15 additions and 2 deletions.
14 changes: 12 additions & 2 deletions draft/high-level-architecture.rst
Original file line number Diff line number Diff line change
Expand Up @@ -273,8 +273,8 @@ The Publisher will later retry publishing the message.
Router
------

In Celery 4.x there was a master process which consumes :term:`Messages <Message>`
and workers which process them.
In Celery 4.x there was a :term:`Celery Master` which was responsible for consuming :term:`Messages <Message>`, storing
results and executing canvases.

In Celery we now decouple the execution of the tasks completely from the routing of :term:`Messages <Message>`
to the `Execution Platform`_.
Expand All @@ -296,6 +296,16 @@ of the task(s).
Execution Platform
------------------

In Celery 4.x we had :term:`Celery Worker` which was responsible for executing tasks.

In Celery we now have an execution platform which will execute tasks and report their results back to the `Router`_.

Celery will provide a default implementation but other implementations may be provided as well by the community or
the maintainers.

Alternative implementations may provide task execution on :term:`Serverless Computing` platforms or as Kubernetes Jobs
for example.

Motivation
==========

Expand Down
3 changes: 3 additions & 0 deletions glossary.rst
Original file line number Diff line number Diff line change
Expand Up @@ -235,6 +235,9 @@ Glossary
This helps you organize your processing logic, and also allows you to keep
an audit log of the inputs to the system.

Serverless Computing
TODO

Ubiquitous Language
TODO

Expand Down

0 comments on commit 76731c8

Please sign in to comment.