Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Limit Seq cache size to when available RAM is less than 4GiB #1020

Closed
larenelg opened this issue Aug 25, 2020 · 2 comments
Closed

Limit Seq cache size to when available RAM is less than 4GiB #1020

larenelg opened this issue Aug 25, 2020 · 2 comments

Comments

@larenelg
Copy link
Contributor

larenelg commented Aug 25, 2020

Since the release of 2020.1 we've had several reports of System.OutOfMemory exceptions being thrown during various operations, particularly on machines with lower available RAM.

We're aiming to improve Seq's stability on smaller machines in 2020.2 by defaulting target system memory utilization to a maximum of 80% of total memory (0.8) for machines with less than 4 GiB of RAM, and 70% for machines with less than 3 GiB.

This default can be overridden by explicitly specifying a RAM target, e.g. to a higher value:

seq config set -k cache.systemRamTarget -v 0.9
seq restart

This setting can also be applied through the SEQ_CACHE_SYSTEMRAMTARGET environment variable.

@larenelg larenelg added this to the 2020.2 milestone Aug 25, 2020
@nblumhardt nblumhardt changed the title Limit Seq cache size to 70% (by default) when available RAM is less than 4GiB Limit Seq cache size to when available RAM is less than 4GiB Aug 25, 2020
@svrooij
Copy link

svrooij commented Sep 2, 2020

@larenelg @nblumhardt We are running this new version 2020.2 inside a docker container on virtual server with 4 gb of ram, and we still have a lot of memory issues.
How do I generate and send you goods logs that actually help?

And is seems that this issue isn't fixed in the new version.

@nblumhardt
Copy link
Member

Hi @svrooij - thanks for the heads-up.

Do you have memory and swap set explicitly for the container, e.g. --memory=3g --memory-swap=3g (or some similar limit that is within the available resources?) Without this, Seq will sometimes "see" more memory available than it is allowed to use.

Setting -e SEQ_CACHE_SYSTEMRAMTARGET=0.7 may also help if the above does not (but setting the memory and swap limits is usually necessary in all cases).

If neither of the above helps, can you please send more information about your container hosting environment, and a diagnostic report, to support@? Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants