Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increasing RAM usage by kapacitor #2051

Open
gaddevijay opened this issue Sep 7, 2018 · 0 comments
Open

Increasing RAM usage by kapacitor #2051

gaddevijay opened this issue Sep 7, 2018 · 0 comments

Comments

@gaddevijay
Copy link

We are using kapacitor to process our data and we see that the RAM usage considerably increases over time and does not seam to stabilize.
In our setup we use UDF's to do some complex operation and checks. With UDF's, RAM usage and build up is much more evident.

As an example I have attached example a tick script, UDF and a python script to generate the required data.
Python script - Sends 4k points to influxdb every 10 seconds. This script can be modified to send the points directly to kapacitor
Tick script - Every 10 seconds fetches last 20 seconds of data and sends it to a UDF 4 times.
UDF - Receives all the points and ignores(to simplify the testing) them

With this single tick script, kapacitor quickly starts consuming ~200MB of RAM and from there on RAM utilisation builds up slowly. In this example, UDF's does not return any points back. If it was returning RAM usage almost doubles.

When 100 such tick scripts are used Kapacitor RAM usage shoots upto ~30GB for RAM and from there on RAM utilisation builds up slowly.

RAM.zip

Could you please check if any optimisations can be done from Kapacitor side.
If there are any suggestions on the UDF side, we could incorporate them as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant