Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Check for missing DagRun rows for "downstream" tables before migrating DB #17030

Merged
merged 5 commits into from
Sep 9, 2021

Conversation

ashb
Copy link
Member

@ashb ashb commented Jul 15, 2021

The migrations and code changes to switch these models over to use
run_id instead of execution_date will follow in future PRs.


^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.

@ashb ashb added the AIP-39 Timetables label Jul 15, 2021
@ashb ashb added this to the Airflow 2.2 milestone Jul 15, 2021
@ashb ashb requested a review from uranusjr July 15, 2021 13:55
@ashb ashb added this to In progress in AIP-39 Pluggable schedule_interval via automation Jul 15, 2021
@ashb ashb changed the title Check for missing DagRun rows for "downstream" tables before applying… Check for missing DagRun rows for "downstream" tables before migrating DB Jul 15, 2021
@ashb ashb moved this from In progress to Review in progress in AIP-39 Pluggable schedule_interval Jul 15, 2021
@ashb
Copy link
Member Author

ashb commented Jul 15, 2021

Oh, thinking about this a bit more, at least RenderedTIFields should go to TaskInstance, not DagRun

airflow/utils/db.py Outdated Show resolved Hide resolved
airflow/utils/db.py Outdated Show resolved Hide resolved
airflow/utils/db.py Outdated Show resolved Hide resolved
@github-actions github-actions bot added the full tests needed We need to run full set of tests for this PR to merge label Sep 7, 2021
@github-actions
Copy link

github-actions bot commented Sep 7, 2021

The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and take the risk. If they don't merge it quickly - please rebase it to the latest main at your convenience, or amend the last commit of the PR, and push it with --force-with-lease.

airflow/utils/db.py Outdated Show resolved Hide resolved
ashb and others added 4 commits September 9, 2021 11:33
… migrations

The migrations and code changes to switch these models over to use
run_id instead of execution_date will follow in future PRs.
Co-authored-by: Tzu-ping Chung <uranusjr@gmail.com>
@ashb ashb force-pushed the check-missing-dagrun-before-migrate branch from fd1c601 to 6ecd6f0 Compare September 9, 2021 10:33
@ashb ashb merged commit 80eb809 into apache:main Sep 9, 2021
AIP-39 Pluggable schedule_interval automation moved this from Reviewer approved to Done Sep 9, 2021
@ashb ashb deleted the check-missing-dagrun-before-migrate branch September 9, 2021 14:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
AIP-39 Timetables full tests needed We need to run full set of tests for this PR to merge
Projects
No open projects
Development

Successfully merging this pull request may close these issues.

None yet

2 participants