Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

deleting hunts very very very slow in 0.72.0/0.72.1 #3485

Open
awx-vsyr opened this issue May 10, 2024 · 2 comments
Open

deleting hunts very very very slow in 0.72.0/0.72.1 #3485

awx-vsyr opened this issue May 10, 2024 · 2 comments

Comments

@awx-vsyr
Copy link

Hello,

we have a cleanup task for housekeeping server hunts. [unfortunately at the moment for self inflicted reasons client monitoring tasks don't work for us]
with 0.72.0/1 it seems like it can't even do 1 or max 1-2 hunts in 10 minutes. (I've added logging to the server event artifact at Mike's request to quantify)

Seemingly the cpu/io/memory perf on the server remained the same. The server is not heavily loaded and there's basically no other hunts happening most of the time . [although I should really check the g nfs performance - but across the master minion no obvious issues ]

@mcohen-r7
Copy link

This likely happens because IO is very slow - you can make it go faster by parallelizing the operations

SELECT * FROM foreach(row={
  SELECT * FROM hunts()
}, query={
  SELECT * FROM hunt_delete(hunt_id=hunt_id, really_do_it=TRUE)
}, workers=10)

We can probably still speed things up a bit more but the above approach will help

@scudette
Copy link
Contributor

Please test with CI build after #3560 and #3561 which should improve performance a lot.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants