Unable to load very large images

[wezell]

Loading very large images, e.g. images that are 30000x20000 pixels and 200mb on disk will cause dotCMS to churn and you will ultimately end up with an OOM exception

[wezell]

Here are very large images to test

https://commons.wikimedia.org/wiki/Commons:Very_high-resolution_file_downloads

https://upload.wikimedia.org/wikipedia/commons/6/6f/Sandro_Botticelli_-_La_nascita_di_Venere_-_Google_Art_Project.jpg

[victoralfaro-dotcms]

Using the birth of Venus image (224.6 MB).
Added a content for that file, zoom in and out at Edit Image modal, published and add a page that contains the image.
No OOM Error seen on the log.

[victoralfaro-dotcms]

BTW all the backend actions were done using Safari since with Chrome it just won't load the image for edition and when it's opened in separate browser tab.

Got a bunch of these:

08:58:27.463  INFO  delegate.SystemEventsJobDelegate - The event: 1edfec6e-0292-43d6-bed4-1362bd1d0066, has been skipped on the server: 57937e0e-81ff-49c9-a52b-9d9a2b61917b
08:58:27.463  INFO  delegate.SystemEventsJobDelegate - The event: b579a635-a8b3-4bff-87a3-8daaa3db89f4, has been skipped on the server: 57937e0e-81ff-49c9-a52b-9d9a2b61917b
08:58:27.463  INFO  delegate.SystemEventsJobDelegate - The event: e2b5536c-9569-4e09-b355-6620468ea346, has been skipped on the server: 57937e0e-81ff-49c9-a52b-9d9a2b61917b
08:58:27.463  INFO  delegate.SystemEventsJobDelegate - The event: f04e1783-98ac-478d-8cb8-98798382d344, has been skipped on the server: 57937e0e-81ff-49c9-a52b-9d9a2b61917b
08:58:27.463  INFO  delegate.SystemEventsJobDelegate - The event: c67c7a8f-81c5-4488-b3cb-44e4cc37b0fd, has been skipped on the server: 57937e0e-81ff-49c9-a52b-9d9a2b61917b
08:58:27.463  INFO  delegate.SystemEventsJobDelegate - The event: 87c61929-aed4-4f1b-a960-fb46dbad2134, has been skipped on the server: 57937e0e-81ff-49c9-a52b-9d9a2b61917b
08:58:27.463  INFO  delegate.SystemEventsJobDelegate - The event: 75a974e7-b195-4535-9bd7-21b2bde17156, has been skipped on the server: 57937e0e-81ff-49c9-a52b-9d9a2b61917b
08:58:27.463  INFO  delegate.SystemEventsJobDelegate - The event: 3bd3996e-8c21-491b-bf1b-4a11d6982b0b, has been skipped on the server: 57937e0e-81ff-49c9-a52b-9d9a2b61917b

[bryanboza]

Fixed, tested on Safari and works fine, seems chrome have problems rendering those kind of images, but this is external to dotCMS. Tested on release-21.07 // Postgres // Safari

[bryanboza]

New card related to the edit image editor here #20639

[jcastro-dotcms]

The fix touches too many files. The risk of putting this in the LTS is too high.

[wezell]

@jcastro-dotcms @swicken-dotcms this needs to be backported into the next planned release of 21.06 LTS - this causes many issues with customers who rely on the image processing - not just with large images but also where multiple servers are reading and writing the same files.

[jcastro-dotcms]

Note for 5.3.8.7 testing:

Because of the size of the image, it can take more than a minute for the thumbnail to be generated. Also, clicking the INFO button in the Image content and clicking the File Link can take a few seconds to load. These situations are expected, and no error is thrown in the log anymore.