Skip to content

Conversation

@guan404ming
Copy link
Member

@guan404ming guan404ming commented Oct 28, 2025

Why

The current bulk delete/update endpoint requires making separate N requests when operating across N DAGs, which:

  • is inefficient and slow (e.g., deleting 500 TIs across 500 DAGs = 500 HTTP requests)
  • Is not atomic - can lead to partial failures/successes that users don't expect

How

Support wildcard (~) matching for dag_id and dag_run_id in bulk task instance API endpoints


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

@boring-cyborg boring-cyborg bot added area:airflow-ctl area:API Airflow's REST/HTTP API area:UI Related to UI/UX. For Frontend Developers. labels Oct 28, 2025
@guan404ming guan404ming force-pushed the bulk-ti-wildcard branch 4 times, most recently from 876c23e to e7e7a33 Compare October 29, 2025 02:19
@guan404ming guan404ming marked this pull request as ready for review October 29, 2025 03:30
Copy link
Member

@jason810496 jason810496 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice! Thanks for the PR!

@guan404ming guan404ming force-pushed the bulk-ti-wildcard branch 4 times, most recently from 6f63537 to 8ef0669 Compare November 4, 2025 07:01
Copy link
Member

@pierrejeambrun pierrejeambrun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice.

I just left a comment, I don't have the bandwidth to do an in depth review but overall the direction looks good.

@guan404ming guan404ming force-pushed the bulk-ti-wildcard branch 3 times, most recently from 0f044db to f985133 Compare November 10, 2025 06:34
@bbovenzi bbovenzi removed the area:UI Related to UI/UX. For Frontend Developers. label Nov 20, 2025
Copy link
Member

@pierrejeambrun pierrejeambrun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One minor nit but looking good to me.

Lets rebase and fix CI and we should be good to move forward. It's a good base and we can iterate on it if needed.

Copy link
Member

@jason810496 jason810496 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the update!
Just some nits about query statements then the PR is good to go.

@guan404ming
Copy link
Member Author

Thanks for the nice suggestion toward the queries. All of them have been updated.

@pierrejeambrun pierrejeambrun added this to the Airflow 3.2.0 milestone Dec 9, 2025
@guan404ming guan404ming merged commit 91ae173 into apache:main Dec 10, 2025
121 checks passed
@guan404ming guan404ming deleted the bulk-ti-wildcard branch December 10, 2025 04:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:airflow-ctl area:API Airflow's REST/HTTP API

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants