Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dag processor manager, add retry_db_transcation to _fetch_callbacks #30079

Merged
merged 2 commits into from Mar 22, 2023

Conversation

michaelmicheal
Copy link
Contributor

As part of moving to a standalone dag processor, we discovered that when this query fails it crashes our standalone daemon (unlike the when it runs in the scheduler in the DagProcessManagerAgent)


^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@boring-cyborg boring-cyborg bot added the area:Scheduler Scheduler or dag parsing Issues label Mar 13, 2023
uranusjr
uranusjr previously approved these changes Mar 14, 2023
@uranusjr uranusjr dismissed their stale review March 14, 2023 04:37

Wait, no, you should not use this with @provide_session

@michaelmicheal michaelmicheal requested review from uranusjr and removed request for ephraimbuddy and jedcunningham March 17, 2023 15:05
@michaelmicheal
Copy link
Contributor Author

@uranusjr good to merge?

@potiuk potiuk merged commit 1f2b0c2 into apache:main Mar 22, 2023
1 check passed
@pierrejeambrun pierrejeambrun added the type:bug-fix Changelog: Bug Fixes label Mar 22, 2023
@pierrejeambrun pierrejeambrun added this to the Airflow 2.5.3 milestone Mar 22, 2023
pierrejeambrun pushed a commit that referenced this pull request Mar 23, 2023
…30079)

* dag processor manager, add retry_db_transcation to _fetch_callbacks

* dag processor manager, create separate method to fetch callbacks with retries to split up provide_session and retry_db_transaction

(cherry picked from commit 1f2b0c2)
pierrejeambrun pushed a commit that referenced this pull request Mar 24, 2023
…30079)

* dag processor manager, add retry_db_transcation to _fetch_callbacks

* dag processor manager, create separate method to fetch callbacks with retries to split up provide_session and retry_db_transaction

(cherry picked from commit 1f2b0c2)
@potiuk potiuk mentioned this pull request Apr 27, 2023
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:Scheduler Scheduler or dag parsing Issues type:bug-fix Changelog: Bug Fixes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants