Skip to content

Document effect of state-store cleanup in ResumableJobMixin - #70718

Merged
potiuk merged 1 commit into
apache:mainfrom
astronomer:warn-cleanup-risk-for-resumablemixin
Jul 30, 2026
Merged

Document effect of state-store cleanup in ResumableJobMixin#70718
potiuk merged 1 commit into
apache:mainfrom
astronomer:warn-cleanup-risk-for-resumablemixin

Conversation

@amoghrajesh

Copy link
Copy Markdown
Contributor

Was generative AI tooling used to co-author this PR?
  • Yes (please specify the tool below)

Running airflow state-store clean while a task's retry_delay exceeds default_retention_days can delete a needed job identifier before the next retry reads it. The operator then silently submits a fresh job instead of reconnecting, which can duplicate work for a job still running externally. Nothing else surfaces this interaction between the two independently configured settings, so it's easy to hit without any error or warning.


  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.

@potiuk
potiuk merged commit cea9e6e into apache:main Jul 30, 2026
70 checks passed
@github-actions

Copy link
Copy Markdown
Contributor

Backport successfully created: v3-3-test

Note: As of Merging PRs targeted for Airflow 3.X
the committer who merges the PR is responsible for backporting the PRs that are bug fixes (generally speaking) to the maintenance branches.

In matter of doubt please ask in #release-management Slack channel.

Status Branch Result
v3-3-test PR Link

vatsrahul1001 pushed a commit that referenced this pull request Jul 31, 2026
…in (#70718) (#70792)

(cherry picked from commit cea9e6e)

Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants