New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
mlr count
using much more memory than expected
#1028
Comments
Hi @jgarthur !! Thanks for submitting this! :) I think the I think the question of leak-or-no-leak depends on the number of unique I will try
etc to get a sense of what's baseline RSS and what's data-dependent. |
Related to #1119 |
mlr count
using much more memory than expected
I've done as much as I can on #1119; please re-open if this is still a blocking issue. |
Hi, thanks for developing this great tool!
I was working on an application of
mlr count -g var1,var2
, wherevar1
andvar2
are both strings, and the input file is quite large (51GB uncompressed). I noticed the memory usage in htop growing until exceeding the uncompressed input file size. Could there be a memory leak here?I've reproduced the issue with a minimal example containing only 1 column:
The text was updated successfully, but these errors were encountered: