-
Notifications
You must be signed in to change notification settings - Fork 3.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Coordinator segment balancer max load queue fix #5888
Coordinator segment balancer max load queue fix #5888
Conversation
This fix as it is currently, will remove servers with a 'full' load queue from consideration as both a destination to move segments to, as well as a source to move segments from. If it is more preferable to still allow moving segments off of these servers, the server list could be duplicated and pick segments from the full set, but on consider moving to the filtered set. |
Cool, I think it'd be good to still allow moves from servers that have a full load queue |
@@ -103,6 +103,7 @@ private void balanceTier( | |||
return; | |||
} | |||
|
|||
final List<ServerHolder> entireServerHolderList = Lists.newArrayList(servers); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
maybe rename these to "sourceServerHolderList" and "destinationServerHolderList"
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
didn't use those exactly, but gave those and some other variables some better names
Updated to let segments still be moved from servers with a full load queue |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍 after CI
* Coordinator segment balancer will now respect "maxSegmentsInNodeLoadingQueue" config * allow moves from full load queues * better variable names
* Coordinator segment balancer will now respect "maxSegmentsInNodeLoadingQueue" config * allow moves from full load queues * better variable names
…#5970) * Coordinator segment balancer will now respect "maxSegmentsInNodeLoadingQueue" config * allow moves from full load queues * better variable names
DruidCoordinatorBalancer
will now respect config settingmaxSegmentsInNodeLoadingQueue
, filtering servers which cross the threshold from potential move targets.Related to #5882