Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix: DagRuns with UPSTREAM_FAILED tasks get stuck in the backfill. #36954

Merged
merged 2 commits into from Jan 26, 2024
Merged

fix: DagRuns with UPSTREAM_FAILED tasks get stuck in the backfill. #36954

merged 2 commits into from Jan 26, 2024

Conversation

avkirilishin
Copy link
Contributor

Closes: #34448

In issue #34448 a bug regarding stuck DagRuns was described. This PR fixes it.

@boring-cyborg boring-cyborg bot added the area:Scheduler Scheduler or dag parsing Issues label Jan 22, 2024
dirrao
dirrao suggested changes Jan 23, 2024
View reviewed changes
Copy link
Collaborator

@dirrao dirrao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Can you check some test cases are failing?

@avkirilishin
Copy link
Contributor Author

LGTM. Can you check some test cases are failing?

There was an issue with #33242
It has already been fixed in #36958
I have merged the changes into this branch.

@eladkal eladkal added the type:bug-fix Changelog: Bug Fixes label Jan 23, 2024
@eladkal eladkal added this to the Airflow 2.8.2 milestone Jan 23, 2024
@potiuk potiuk merged commit edce535 into apache:main Jan 26, 2024
56 checks passed
amoghrajesh pushed a commit to amoghrajesh/airflow that referenced this pull request Jan 30, 2024
@avkirilishin @amoghrajesh
fix: DagRuns with UPSTREAM_FAILED tasks get stuck in the backfill. (a…
817c5a4 
…pache#36954)
jedcunningham pushed a commit that referenced this pull request Feb 9, 2024
@avkirilishin @jedcunningham
fix: DagRuns with UPSTREAM_FAILED tasks get stuck in the backfill. (#…
2096019 
…36954)

(cherry picked from commit edce535)
potiuk pushed a commit that referenced this pull request Feb 13, 2024
@avkirilishin @potiuk
fix: DagRuns with UPSTREAM_FAILED tasks get stuck in the backfill. (#…
ad43b5b 
…36954)

(cherry picked from commit edce535)
ephraimbuddy pushed a commit that referenced this pull request Feb 22, 2024
@avkirilishin @ephraimbuddy
fix: DagRuns with UPSTREAM_FAILED tasks get stuck in the backfill. (#…
2bad7ab 
…36954)

(cherry picked from commit edce535)
@ephraimbuddy ephraimbuddy mentioned this pull request Feb 22, 2024
Closed
68 tasks
abhishekbhakat pushed a commit to abhishekbhakat/my_airflow that referenced this pull request Mar 5, 2024
@avkirilishin @abhishekbhakat
fix: DagRuns with UPSTREAM_FAILED tasks get stuck in the backfill. (a…
0b56df8 
…pache#36954)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@potiuk potiuk potiuk approved these changes

@dirrao dirrao dirrao approved these changes

@kaxil kaxil Awaiting requested review from kaxil kaxil is a code owner

@ashb ashb Awaiting requested review from ashb ashb is a code owner

@XD-DENG XD-DENG Awaiting requested review from XD-DENG XD-DENG is a code owner

@hussein-awala hussein-awala Awaiting requested review from hussein-awala

Assignees
No one assigned
Labels
area:Scheduler Scheduler or dag parsing Issues type:bug-fix Changelog: Bug Fixes
Projects
None yet
Milestone
Airflow 2.8.2
Development

Successfully merging this pull request may close these issues.

dag stuck in "running" status when running in backfill job
4 participants
@avkirilishin @potiuk @dirrao @eladkal