Skip to content

Comments

Optimize scheduler processing query#25516

Closed
dene14 wants to merge 2 commits intoapache:mainfrom
dene14:25448
Closed

Optimize scheduler processing query#25516
dene14 wants to merge 2 commits intoapache:mainfrom
dene14:25448

Conversation

@dene14
Copy link
Contributor

@dene14 dene14 commented Aug 3, 2022

closes: #25448

In my test case query execution time went from 8 seconds down to 290ms
Explain plan:
image

Do we have unit tests that validate scheduler workflow?

@boring-cyborg boring-cyborg bot added the area:Scheduler including HA (high availability) scheduler label Aug 3, 2022
@potiuk potiuk requested a review from ashb August 3, 2022 18:17
@dene14 dene14 closed this Aug 3, 2022
@dene14 dene14 deleted the 25448 branch August 3, 2022 20:49
@argibbs
Copy link
Contributor

argibbs commented Feb 23, 2023

@dene14 Can I ask what happened here? Did you realise the changed query wasn't equivalent? Or is there something else going on?

@dene14
Copy link
Contributor Author

dene14 commented Feb 23, 2023

@argibbs yes, it wasn't equivalent for some cases unfortunately. Cannot be improved w/o ERD re-work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:Scheduler including HA (high availability) scheduler

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Scheduler polling is extremely heavy for big DAGs

2 participants