Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to calculate Heap and RAM requirements for Kafka Backup #47

Open
itadventurer opened this issue Mar 31, 2020 · 1 comment
Open

How to calculate Heap and RAM requirements for Kafka Backup #47

itadventurer opened this issue Mar 31, 2020 · 1 comment
Labels
question Further information is requested

Comments

@itadventurer
Copy link
Owner

seems -Xmx1024M or Docker memory_limit=1152M is not enough for this cluster :( Any ideas about how to calculate HEAP/RAM size for kafka-backup?

I have currently no idea how to calculate this – let us discuss how to approximate the Heap and Memory usage.

@itadventurer itadventurer added the question Further information is requested label Mar 31, 2020
@jay7x
Copy link
Contributor

jay7x commented May 30, 2020

Some stats JFYI:

USER        PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root     103012  117 57.3 4737912 2304136 ?     Ssl  08:43  75:50 /opt/java/openjdk/bin/java -Xms256M -Xmx2048M [...]

UPD 1:
with -Xmx 1024M on same cluster I got OOM:

Exception in thread "qtp99042020-21" java.lang.OutOfMemoryError: Java heap space

UPD 2:
it's running fine again with -Xmx1536M

UPD 3:
failed after few weeks with OOM, so increased it to 2048M again..

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants