Skip to content

Comments

Ensure teardown failure with on_failure_fail_dagrun=True fails the DagRun#30398

Merged
ephraimbuddy merged 6 commits intoapache:mainfrom
astronomer:determine-dag-success
May 8, 2023
Merged

Ensure teardown failure with on_failure_fail_dagrun=True fails the DagRun#30398
ephraimbuddy merged 6 commits intoapache:mainfrom
astronomer:determine-dag-success

Conversation

@ephraimbuddy
Copy link
Contributor

@ephraimbuddy ephraimbuddy commented Mar 31, 2023

My approach here is not to include teardown tasks in the leaf_tis when deciding on dagrun state except if the teardown task has _on_failure_fail_dagrun set

  • Add test for when a teardown has upstream failed

closes: #29125

@ephraimbuddy ephraimbuddy added the changelog:skip Changes that should be skipped from the changelog (CI, tests, etc..) label Mar 31, 2023
@ephraimbuddy ephraimbuddy marked this pull request as draft March 31, 2023 17:15
@ephraimbuddy ephraimbuddy added the AIP-52 Automatic setup and teardown tasks label Mar 31, 2023
@ephraimbuddy ephraimbuddy force-pushed the determine-dag-success branch from 555c63a to f6b0740 Compare March 31, 2023 19:54
@ephraimbuddy ephraimbuddy marked this pull request as ready for review March 31, 2023 19:54
@ephraimbuddy ephraimbuddy force-pushed the determine-dag-success branch 3 times, most recently from d7cd3f3 to c82b9ce Compare April 4, 2023 14:58
@ephraimbuddy ephraimbuddy marked this pull request as draft April 5, 2023 17:30
@ephraimbuddy ephraimbuddy marked this pull request as ready for review April 26, 2023 09:54
@ephraimbuddy ephraimbuddy force-pushed the determine-dag-success branch 2 times, most recently from 190c121 to 6425f2e Compare May 4, 2023 08:10
…gRun

My approach here is not to include teardown tasks in the leaf_tis when
deciding on dagrun state except if the teardown task has _on_failure_fail_dagrun
set
@ephraimbuddy ephraimbuddy force-pushed the determine-dag-success branch from 6425f2e to 90d0b23 Compare May 8, 2023 07:58
ephraimbuddy and others added 2 commits May 8, 2023 09:01
Co-authored-by: Jed Cunningham <66968678+jedcunningham@users.noreply.github.com>
@ephraimbuddy ephraimbuddy merged commit db359ee into apache:main May 8, 2023
@ephraimbuddy ephraimbuddy deleted the determine-dag-success branch May 8, 2023 10:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

AIP-52 Automatic setup and teardown tasks changelog:skip Changes that should be skipped from the changelog (CI, tests, etc..)

Projects

No open projects

Development

Successfully merging this pull request may close these issues.

Ensure teardown failure with on_failure_fail_dagrun=True fails the DagRun, and not otherwise

2 participants