Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

cubestore memory leak #7545

Open
schneefux opened this issue Dec 18, 2023 · 2 comments
Open

cubestore memory leak #7545

schneefux opened this issue Dec 18, 2023 · 2 comments
Assignees
@ovr
Labels
backend:cube-store Issues relating to Cube Store question The issue is a question. Please use Stack Overflow for questions.

Comments

@schneefux
Copy link

Describe the bug
I am running a self-hosted cubestore router with docker in a Nomad cluster. Since the last upgrade, after about 10 minutes, cubestore OOMs or becomes unresponsive to readyz checks and gets restarted by the Nomad scheduler. There are 3-5 cube API instances connected to my cubestore router, doing 10-50 queries per second each. There are no preaggregations or workers set up.

Memory usage before, with v0.34.33:
image

Memory usage now, with v0.34.36:
image
@paveltiunov paveltiunov added the question The issue is a question. Please use Stack Overflow for questions. label Dec 23, 2023
@igorlukanin igorlukanin added the backend:cube-store Issues relating to Cube Store label Jan 2, 2024
@schneefux schneefux mentioned this issue Mar 20, 2024
Closed
4 tasks
@ovr
Copy link
Member

ovr commented Apr 5, 2024

Hello @schneefux ,

I made some improvements across the last releases.
Could you give it a try v0.35.8?

Thanks

@ovr ovr mentioned this issue Apr 10, 2024
Merged
ovr added a commit that referenced this issue Apr 10, 2024
@ovr
feat(cubestore): Enable jemalloc allocator for RocksDB on linux GNU (#…
ee7bcee 
…8104)

refs #7545
JichaoS pushed a commit to luabase/cube that referenced this issue May 7, 2024
@ovr @JichaoS
feat(cubestore): Enable jemalloc allocator for RocksDB on linux GNU (c…
e5bd69d 
…ube-js#8104)

refs cube-js#7545
@igorlukanin
Copy link
Member

@schneefux Did you try the latest version? I've seen reports in the community Slack (https://slack.cube.dev) that it makes a real difference with regards to memory.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ovr ovr

Labels
backend:cube-store Issues relating to Cube Store question The issue is a question. Please use Stack Overflow for questions.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@paveltiunov @ovr @igorlukanin @schneefux