Memory usage

[oduis]

The official 1.0 release binary crashes on Windows encoding a 24 MP photo.
It seems like this is a RAM issues, since it quickly eats gigabytes of RAM before crashing.
Is there a 64bit version? And is the RAM usage expected?

[khavishbhundoo]

There is only a 32bit version for windows currently.I think it would help if you could provide the photo.

[oduis]

Unfortunately the file is pretty large, so I put it on my website:
http://www.visualbakery.com/Download/CrashGuetzliOnWindows_RAMOverflow.png
It does not seem to be dependent on the file. Other photos of this size crash Gruetzli, too.

[robryk]

I've encoded that image on 64bit linux. It seems that it uses north of 5GB of memory, so it would use not less than half of that on a 32bit system (and likely much more than half, because memory usage of all the pointers is a small fraction of all that memory), which is over 2GB (which is presumably the address space available there). I will add Windows 64bit binaries to the release shortly.

I agree that Guetzli is very wasteful with memory (it keeps multiple unnecessary copies of the whole image). I would very much welcome any PRs that get rid of some of the unnecessary copies of the images or similar things.

[robryk]

Also, please note that Guetzli assumes that the image will be viewed at a reasonable DPI. If the image will be downsampled before viewing, Guetzli will use up a significant amount of space for the details that will not be visible due to downsampling.

[oduis]

The use case for me would be to have a tool that converts Lightroom output to an optimized format.
Since the camera images are pretty large 20% makes a lot of difference.
I was wondering if Guetzli is better than Lightrooms JPG outplus plus JPGMini for compression.
But I guess I have to wait till the Guetzli is a bit more optimized.

[Furniel]

oduis
X64 windows build, just for testing(may be buggy). Your image was optimized successfully, but guetzli need more than 5gb of ram and a lot of time to process your test image.
https://mega.nz/#!p8EUSIQR!IfgMKQeuLMR2gtOnSCgDGRtulFINI6Nw0t-vtlZd-_0

[oduis]

Thanks for the build, Furniel! It works, however after first tests Guetzli is awful slow, even on powerful i7 processor.
The compression results with large photos seem to be not really better than Lightroom + JPGMini.
So I guess Guetzli is not really good for this use case. Maybe it is better suited for small pictures with strong compression.

[robryk]

The new release contains 64 bit Windows binaries.