Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Platform] Suggest more intelligent default parallelism for backup/restores based on universe specs #7090

Open
daniel-yb opened this issue Feb 3, 2021 · 2 comments
Open

[Platform] Suggest more intelligent default parallelism for backup/restores based on universe specs #7090

daniel-yb opened this issue Feb 3, 2021 · 2 comments
Labels
area/platform Yugabyte Platform
Projects
Platform Backups

Comments

@daniel-yb
Copy link
Contributor

Based on the number of nodes/the specs of nodes in a universe, we can calculate a better default level of parallelism for backups besides the hardcoded default of 8 threads suggested to the user at the moment.
@daniel-yb daniel-yb added the area/platform Yugabyte Platform label Feb 3, 2021
@daniel-yb daniel-yb added this to To do in Platform Feb 3, 2021
@daniel-yb
Copy link
Contributor Author

This and #3852 will help improve backup performance for customers.

@bmatican bmatican mentioned this issue Feb 3, 2021
Closed
@bmatican bmatican added this to To do in Backups via automation Feb 3, 2021
@bmatican
Copy link
Contributor

bmatican commented Feb 3, 2021

one note here we had also discussed, is that we likely want some cap on total parallelism, otherwise YW will end up with too many outstanding SSH connections, etc

@streddy-yb streddy-yb mentioned this issue Apr 22, 2021
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area/platform Yugabyte Platform
Projects
Backups
  
To do
Platform
  
To do
Milestone
No milestone
Development

No branches or pull requests
2 participants
@bmatican @daniel-yb