Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

TaskGroup Sensor #14563

Closed
nathadfield opened this issue Mar 2, 2021 · 1 comment · Fixed by #24902
Closed

TaskGroup Sensor #14563

nathadfield opened this issue Mar 2, 2021 · 1 comment · Fixed by #24902
Assignees
@pateash
Labels
area:core-operators Operators, Sensors and hooks within Core Airflow area:TaskGroup good first issue kind:feature Feature Requests

Comments

@nathadfield
Copy link
Collaborator

Description

Enable the ability for a task in a DAG to wait upon the successful completion of an entire TaskGroup.

Use case / motivation

TaskGroups provide a great mechanism for authoring DAGs, however there are situations where it might be necessary for a task in an external DAG to wait upon the the completion of the TaskGroup as a whole.

At the moment this is only possible with one of the following workarounds:

  1. Add an external task sensor for each task in the group.
  2. Add a Dummy task after the TaskGroup which the external task sensor waits on.

I would envisage either adapting ExternalTaskSensor to also work with TaskGroups or creating a new ExternalTaskGroupSensor.

Are you willing to submit a PR?

Time permitting, yes!

Related Issues
@nathadfield nathadfield added the kind:feature Feature Requests label Mar 2, 2021
@xinbinhuang xinbinhuang mentioned this issue Mar 6, 2021
Closed
@eladkal eladkal added area:core-operators Operators, Sensors and hooks within Core Airflow and removed area:core labels Mar 25, 2021
@pateash
Copy link
Contributor

pateash commented Jun 16, 2022

@eladkal, I would like to take this up.

@pateash pateash mentioned this issue Jul 7, 2022
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@pateash pateash

Labels
area:core-operators Operators, Sensors and hooks within Core Airflow area:TaskGroup good first issue kind:feature Feature Requests
Projects
None yet
Milestone
No milestone
3 participants
@nathadfield @pateash @eladkal