Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
"Java heap space" error thrown exporting a large csv file #5187
Thanks for being part of the Metabase project!
Exporting a large file breaks metabase and shows a json error in the browser.
When exporting a query on XLSX, my metabase instance memory skyrocket until the Java heap space memory error is thrown.
Hello, I got the same issue when exporting (20k rows * 11 columns) raw data to csv/xlsx on metabase v0.25.1 docker container.
In addition, when exporting smaller data set, say 5k or 1k rows, I observed RAM usage increased, but not release afterwards. (Redash released memory with the same test case). This situation makes the RAM usage gradually increase and reach the memory limit at late of work-day.
referenced this issue
Sep 25, 2017
@thucnc, @hai-ld looks like the PR mjul/docjure#47 with addition of streaming support got stuck on the lack of missing test code demonstrating that it supports existing features of the Docture library. I think that’s a fair request from the Docture maintainer.
Until that fix can happen - which in turn will hopefully also better .xlsx export memory consumption with Metabase here a few work-around suggestions: