Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[docdb] load balance: per table limit on remote bootstraps #4436

Closed
bmatican opened this issue May 9, 2020 · 0 comments
Closed

[docdb] load balance: per table limit on remote bootstraps #4436

bmatican opened this issue May 9, 2020 · 0 comments
Assignees
@hectorgcr
Labels
area/docdb YugabyteDB core features
Projects
YBase features Master components

Comments

@bmatican
Copy link
Contributor

bmatican commented May 9, 2020

As part of #4053 we're switching the semantics of the LB throttle for remote bootstraps to be global, in order to not start too many concurrent operations in the cluster. We should however add back a mechanism to support a per-table control.

This could allow us to make more healthy progress, in the case of very large tables otherwise starving the balancing process.
@bmatican bmatican added the area/docdb YugabyteDB core features label May 9, 2020
@bmatican bmatican added this to Short term in Master components May 9, 2020
hectorgcr added a commit that referenced this issue May 22, 2020
@hectorgcr
#4436: Limit the number of remote bootstrap sessions per table
5469e06 
Summary:
Before #4053, each table was allowed to have up the specified limit, although this was not the intention of the flag.

Now that it has been fixed, it's posible that one or the first few tables that get analyzed by the load balancer consume all the remote bootstrap sessions allowed by the flag. So this change limits the number of RBS sessions per table to give all the tables a chance to make progress.

Test Plan: ybd release --cxx-test integration-tests_remote_bootstrap-itest --gtest_filter RemoteBootstrapITest.TestLimitNumberOfConcurrentRemoteBootstraps -n 100

Reviewers: bogdan

Reviewed By: bogdan

Subscribers: ybase

Differential Revision: https://phabricator.dev.yugabyte.com/D8455
@bmatican bmatican added this to Done in YBase features via automation Jun 11, 2020
Master components automation moved this from Short term to Done Jun 11, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@hectorgcr hectorgcr

Labels
area/docdb YugabyteDB core features
Projects
Master components
  
Done
YBase features
  
Done
Milestone
No milestone
Development

No branches or pull requests
2 participants
@bmatican @hectorgcr