Skip to content

Commit

Permalink
docs: Move general worker design to handbook
Browse files Browse the repository at this point in the history
  • Loading branch information
jpmckinney committed Apr 17, 2024
1 parent fdd1d9f commit 85373c0
Showing 1 changed file with 0 additions and 6 deletions.
6 changes: 0 additions & 6 deletions docs/reference/overview.rst
Expand Up @@ -20,12 +20,6 @@ Workers can be daemonized and run in parallel. The pipeline is:
#. The :ref:`check-time-based` worker performs the time-based checks. After, it publishes the ID of the dataset.
#. The :ref:`report` worker creates field-level and compiled release-level reports, picks field-level and compiled release-level examples, and updates the dataset's metadata.

Workers are `Click <https://click.palletsprojects.com/>`__ programs that are:

- as stateless as possible, since messages can arrive in any order
- as idempotent as possible, since messages can be redelivered
- able to run in parallel, to maximize throughput

.. _repository-structure:

Repository structure
Expand Down

0 comments on commit 85373c0

Please sign in to comment.