You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In my use case, Airflow is mostly used to orchestrate and define chains of tasks in reproducible DAGs. Most of the time, the resulting DAGs are triggered manually via the Web interface.
It would be very convenient to be able to trigger DAGs manually with a certain delay or to actually start only at a specified time. Until today, I was under the impression that airflow doesn't provide this out of the box (see e.g. #33068 (reply in thread))
However, I discovered that the current version provides a handy workaround for this: If you manually trigger a DAG via the UI and set the logical date to the future, DAG tasks won't start until the specified time has come.
This seems to stem from this change #46663. However, there is some debate if this behavior is to be desired #65856.
So my question would be: To what extend can I expect this behavior to work in the future? Are there drawbacks? Most of the technical details mentioned in the linked discussions are frankly lost on me, but it feels like this is a rather "hacky" circumstance, although the resulting behavior (being able to set a start time for your manually triggered DAG tasks in the UI) is arguably exactly what I would have wished for.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
In my use case, Airflow is mostly used to orchestrate and define chains of tasks in reproducible DAGs. Most of the time, the resulting DAGs are triggered manually via the Web interface.
It would be very convenient to be able to trigger DAGs manually with a certain delay or to actually start only at a specified time. Until today, I was under the impression that airflow doesn't provide this out of the box (see e.g. #33068 (reply in thread))
However, I discovered that the current version provides a handy workaround for this: If you manually trigger a DAG via the UI and set the logical date to the future, DAG tasks won't start until the specified time has come.
This seems to stem from this change #46663. However, there is some debate if this behavior is to be desired #65856.
So my question would be: To what extend can I expect this behavior to work in the future? Are there drawbacks? Most of the technical details mentioned in the linked discussions are frankly lost on me, but it feels like this is a rather "hacky" circumstance, although the resulting behavior (being able to set a start time for your manually triggered DAG tasks in the UI) is arguably exactly what I would have wished for.
Beta Was this translation helpful? Give feedback.
All reactions