-
Notifications
You must be signed in to change notification settings - Fork 6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
mgr/balancer: cast config vals to int or float #19493
Conversation
upmap_max_iterations and other config vals need to be numeric. Cast them appropriately. Signed-off-by: Dan van der Ster <daniel.vanderster@cern.ch> Fixes: http://tracker.ceph.com/issues/22429
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yes!
Note that there is a fair bit of work that can be done to improve the current balancer behavior (although what is there now works reasonably well!). I'm very excited to see how well it does on a large cluster--I only had our janky lab cluster to test against (which was a real mess weight-wise but only ~100 osds). |
Yeah I'm slowly testing it now -- so far so good :) (except this other small learning-curve issue http://tracker.ceph.com/issues/22424) crush-compat seemed to work well enough on an older 3-host, 72-osd cluster -- but that has only one root, is uniform. Here's how it managed on that cluster:
And with upmap on a newer 381-osd, 127-host cluster, much less uniform (but still single root) it managed:
Both were quite imbalanced to start. One potential problem I noticed is that upmap works sequentially by pool -- in my test cluster I have 3 (currently empty) pools, and it managed to balance things by upmapping only the first pool. I guess this was the intention of And BTW it was very nice that crush-compat mode gradually increased the osd reweights back to 1.0 -- this will greatly simplify the phase-in on our already-reweighed clusters. Last thing I need is a way to slowly phase in new hardware (start with 0 pgs then let the balancer slowly map PGs to them) -- possibly its already doable with the existing balancer, or otherwise it shouldn't be too complicated. |
That was definitely the intention of the shuffle.. curious why it didn't work! Note that the upmap mode doesn't do the reweights back to 1.0. :( |
http://tracker.ceph.com/issues/22431 for that shuffle issue. |
upmap_max_iterations and other config vals need to be numeric.
Cast them appropriately.
Signed-off-by: Dan van der Ster daniel.vanderster@cern.ch
Fixes: http://tracker.ceph.com/issues/22429