Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

High write performance overhead of Connection Pooling #4252

Closed
RaulGracia opened this issue Oct 7, 2019 · 5 comments
Closed

High write performance overhead of Connection Pooling #4252

RaulGracia opened this issue Oct 7, 2019 · 5 comments

Comments

@RaulGracia
Copy link
Contributor

Problem description
We have observed that connection pooling imposes a really high overhead to the maximum write throughput of clients, as well as important latency increase:

comparison

We need to investigate if this problem can be mitigated.

Problem location
Client, connection pooling.

Suggestions for an improvement
Improve the performance of connection pooling (at least on the writer side).

@tkaitchuck
Copy link
Member

This is in no way surprising. I think we should simply disable it on the append path. For all other APIs it makes sense but for append it forces small batches regardless of the optimal batch size determined by the algorithm. @fpj Do you have any thoughts?

@RaulGracia
Copy link
Contributor Author

@tkaitchuck disabling this for writers and not for readers would lead to an asymmetric performance situation in which readers will not be able to cope with written events?

@tkaitchuck
Copy link
Member

@RaulGracia I don't think that should be the case. Can you measure Read throughput so we can tell if that is the case?

@RaulGracia
Copy link
Contributor Author

@tkaitchuck should we close this issue based on #4253 or we need to keep this issue open for further investigating how to optimize the performance of connection pooling?

@RaulGracia
Copy link
Contributor Author

Closed via #4253.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants