[v3-2-test] fix(scheduler): catch StaleDataError in verify_integrity to prevent scheduler crash (#64503)#66727
Merged
Merged
Conversation
…to prevent scheduler crash (#64503) Closes #63926 StaleDataError raised by SQLAlchemy's optimistic locking when a concurrent session modifies the same row can cause the scheduler to crash during verify_integrity. Fix by catching StaleDataError alongside IntegrityError in dagrun.verify_integrity() and adding it to the retry exceptions in run_with_db_retries()/retry_db_transaction() so the operation is retried automatically. (cherry picked from commit dcfa271) Co-authored-by: Pradeep Kalluri <128097794+kalluripradeep@users.noreply.github.com>
potiuk
force-pushed
the
backport-dcfa271-v3-2-test
branch
from
e5762a4 to
fc8f2a2
Compare
vatsrahul1001
pushed a commit
that referenced
this pull request
May 20, 2026
…to prevent scheduler crash (#64503) (#66727) Closes #63926 StaleDataError raised by SQLAlchemy's optimistic locking when a concurrent session modifies the same row can cause the scheduler to crash during verify_integrity. Fix by catching StaleDataError alongside IntegrityError in dagrun.verify_integrity() and adding it to the retry exceptions in run_with_db_retries()/retry_db_transaction() so the operation is retried automatically. (cherry picked from commit dcfa271) Co-authored-by: Pradeep Kalluri <128097794+kalluripradeep@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Closes #63926
StaleDataError raised by SQLAlchemy's optimistic locking when a concurrent
session modifies the same row can cause the scheduler to crash during
verify_integrity. Fix by catching StaleDataError alongside IntegrityError
in dagrun.verify_integrity() and adding it to the retry exceptions in
run_with_db_retries()/retry_db_transaction() so the operation is retried
automatically.
(cherry picked from commit dcfa271)
Co-authored-by: Pradeep Kalluri 128097794+kalluripradeep@users.noreply.github.com