Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The clustering process will be delayed by exceeding the rate limit for requests to the api-server. #517

Closed
4 tasks
kmdkuk opened this issue Mar 16, 2023 · 0 comments
Assignees

Comments

@kmdkuk
Copy link
Contributor

kmdkuk commented Mar 16, 2023

What

If there are a large number of MySQLCluster resources, the clustering process will be delayed by exceeding the rate limit for requests to the api-server.
It has been observed that when the clustering process is delayed, operations such as switchover are also delayed.

The default rate limit (QPS) is 20.
https://github.com/kubernetes-sigs/controller-runtime/blob/a26de2d610c3cf4b2a02688534aaf5a65749c743/pkg/client/config/config.go#L84-L85

We have observed a delay of about 20 seconds when we created about 400 Clusters.
The high frequency of calls to MySQLCluster reconcile causes processing delays even when MySQLCluster resources are less than 400.

How

Add QPS to moco-controller's options.

Checklist

  • Finish implementation of the issue
  • Test all functions
  • Have enough logs to trace activities
  • Notify developers of necessary actions
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants