Eirini Events High memory consumption

[KesavanKing]

Description

We did a scalability tests on cf-for-k8s version v-0.6.0. We deployed 1000 apps out of which 50 apps are meant to crash frequently. We could see eirini-events pod was consuming high memory > 10Gi and automatically restart happens and memory reduces. We suspect some memory leak.

Steps to reproduce

Deploy crashing apps - Example and observe the eirini-events pod memory usage.

What actually happened

Memory consumption is very high

[cf-gitbot]

We have created an issue in Pivotal Tracker to manage this:

https://www.pivotaltracker.com/story/show/174691150

The labels on this github issue will be updated when the story is started.

[kieron-dev]

Hi @KesavanKing ,

We're having a problem reproducing this. We're not seeing any significant memory increases with 400 happy apps, and 50 crashing apps. If you could give us some steps to reproduce the environment you're seeing this in that would be good.

Also though, we have totally rewritten the event reporter code since the version included in cf-for-k8s v0.6.0. It might be worth repeating the experiment with the next cf-for-k8s, as it could well be already fixed.

[KesavanKing]

Hi 👋 ,

We did our scalability tests for the pre-release 0.7.0 of cf-for-k8s and the issue didn't occur. Memory usage was under the control.

Thanks for the support.