Skip to content

Commit

Permalink
[doc] clarification around the scheduler
Browse files Browse the repository at this point in the history
  • Loading branch information
mistercrunch committed Jun 23, 2015
1 parent 406d31c commit b235411
Showing 1 changed file with 12 additions and 1 deletion.
13 changes: 12 additions & 1 deletion docs/scheduler.rst
Original file line number Diff line number Diff line change
Expand Up @@ -4,9 +4,20 @@ The Scheduler
The Airflow scheduler monitors all tasks and all dags and schedules the
task instances whose dependencies have been met. Behinds the scene,
it monitors a folder for all dag objects it may contain,
and periodically inspects all tasks to see whether is can schedule the
and periodically inspects all tasks to see whether it can schedule the
next run.

The scheduler starts an instance of the executor specified in the your
``airflow.cfg``, if it happens to be the LocalExecutor, tasks will be
executed as subprocesses, in the case of CeleryExecutor, tasks are
executed remotely.

To start a scheduler, simply run the command:

.. code:: bash
airflow scheduler
Note that:

* It **won't parallelize** multiple instances of the same tasks, it always wait for the previous schedule to be done to move forward
Expand Down

0 comments on commit b235411

Please sign in to comment.