Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Limiting and controlling a write queue #478

Open
2mik opened this issue Mar 5, 2023 · 2 comments
Open

Limiting and controlling a write queue #478

2mik opened this issue Mar 5, 2023 · 2 comments

Comments

@2mik
Copy link

2mik commented Mar 5, 2023

Proposal:
According to the docs, WriteApi supports batching. If I understand correctly, there is something like an internal queue to send data to server in batches. An application is actively writes data, but I cannot control from my code if sending is fast enough and data are not infinitely collected in memory. It would be very useful to control the current size of the queue and set it's max size.

Current behavior:
Cannot find how to control and limit writing to DB server.

Desired behavior:
Be able to setup and control how data is written.

Alternatives considered:
Without the requested function, I have to implement my own queue and add new data by WriteApiAsync.

Use case:
Industrial monitoring systems generate a lot of data (we develop SCADA). And it's important to clearly understand if our service is able to send all data or not, and avoid using too much memory.
Thank you for your work.

@2mik 2mik changed the title Limit and control of writing queue Limiting and controlling a write queue Mar 5, 2023
@niranjanhm-bh-git
Copy link

Agree and #477 is similar to above

@2mik
Copy link
Author

2mik commented Mar 16, 2023

What if the connection to the database is broken? Do we get unlimited memory consumption?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants