You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We are using kapacitor to process our data and we see that the RAM usage considerably increases over time and does not seam to stabilize.
In our setup we use UDF's to do some complex operation and checks. With UDF's, RAM usage and build up is much more evident.
As an example I have attached example a tick script, UDF and a python script to generate the required data.
Python script - Sends 4k points to influxdb every 10 seconds. This script can be modified to send the points directly to kapacitor
Tick script - Every 10 seconds fetches last 20 seconds of data and sends it to a UDF 4 times.
UDF - Receives all the points and ignores(to simplify the testing) them
With this single tick script, kapacitor quickly starts consuming ~200MB of RAM and from there on RAM utilisation builds up slowly. In this example, UDF's does not return any points back. If it was returning RAM usage almost doubles.
When 100 such tick scripts are used Kapacitor RAM usage shoots upto ~30GB for RAM and from there on RAM utilisation builds up slowly.
Could you please check if any optimisations can be done from Kapacitor side.
If there are any suggestions on the UDF side, we could incorporate them as well.
The text was updated successfully, but these errors were encountered:
We are using kapacitor to process our data and we see that the RAM usage considerably increases over time and does not seam to stabilize.
In our setup we use UDF's to do some complex operation and checks. With UDF's, RAM usage and build up is much more evident.
As an example I have attached example a tick script, UDF and a python script to generate the required data.
Python script - Sends 4k points to influxdb every 10 seconds. This script can be modified to send the points directly to kapacitor
Tick script - Every 10 seconds fetches last 20 seconds of data and sends it to a UDF 4 times.
UDF - Receives all the points and ignores(to simplify the testing) them
With this single tick script, kapacitor quickly starts consuming ~200MB of RAM and from there on RAM utilisation builds up slowly. In this example, UDF's does not return any points back. If it was returning RAM usage almost doubles.
When 100 such tick scripts are used Kapacitor RAM usage shoots upto ~30GB for RAM and from there on RAM utilisation builds up slowly.
RAM.zip
Could you please check if any optimisations can be done from Kapacitor side.
If there are any suggestions on the UDF side, we could incorporate them as well.
The text was updated successfully, but these errors were encountered: