Skip to content

Adds support for starting multiple managers per host#6228

Merged
ddanielr merged 4 commits intoapache:mainfrom
ddanielr:feature/accumulo-6212
Mar 21, 2026
Merged

Adds support for starting multiple managers per host#6228
ddanielr merged 4 commits intoapache:mainfrom
ddanielr:feature/accumulo-6212

Conversation

@ddanielr
Copy link
Contributor

Updates the cluster.yaml format to support setting the number of manager processes per host.

Closes: #6212

If managers should be organized under a resource group then this PR can be easily modified to support that.

Updates the cluster.yaml format to support running multiple managers on
the same host.
@ddanielr ddanielr added this to the 4.0.0 milestone Mar 20, 2026
@ddanielr ddanielr requested a review from keith-turner March 20, 2026 03:59
@dlmarion
Copy link
Contributor

I don't think we should put managers into resource groups until we define what that means.

As a user I would assume that if a manager was in the test resource group, then it would manage all of the other resources and tables that were also in the test resource group. That might seem wasteful resource-wise if nothing is really happening in the test resource group.

A user might want to then have the manager manage the resources in multiple resource groups. So instead of putting the manager into a resource group, the manager would have resource groups assigned to it to manage.

Right now we have a default resource group that everything is lumped into. Because the root and metadata tables are in the default resource group it has a minimum requirement of 1 tablet server and 1 compactor. If we are going to keep the current multiple manager design, equal distribution of work across managers, it might make sense to have a system resource group that the managers, gc and monitor use (and cannot be changed) with the 1 tablet server and 1 compactor minimum.

Use the number of manager services per host
Updates the --manager flags to --managers
Also updates -manager to -managers in ZooZap

Moves stream into try-with-resources loop
@ddanielr ddanielr merged commit 756e17c into apache:main Mar 21, 2026
9 checks passed
@ddanielr ddanielr deleted the feature/accumulo-6212 branch March 21, 2026 01:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Support running multiple manager per host in accumulo-cluster script

3 participants