Bug Fix: A bug where images load slowly when accessing pages with many images. (in remote server. eg, aws)

[asynclee]

About #2424 issue.

Bug summary

Bug where images load slowly when accessing pages with many images. Additionally, when the loading is slow, the backend does not receive any additional requests, which causes slow access as well.

Why the bug is not detected in the local environment ?

In the local environment, the speed of reading images was so fast that the issue did not cause any bottleneck. However, in a remote environment, such as an EC2+EBS environment, the disk response speed is not as fast as a local disk, so the logic related to loading images can cause a bottleneck. This results in the issue where the backend does not receive additional requests when the loading is slow, leading to slow access.

What part is the problem ?

In the existing logic, when receiving image uri arrays through the getbatch logic, the uri array is initialized after the loading is completed. In other words, for example,

Assume that 50 image uri arrays are being processed,
While processing the above images, if 20 uri array requests come in, a getbatch operation requesting 70 uri arrays including the 20 uri arrays additionally requested on the existing 50 uri array being processed is performed.
If this process is repeated, many duplicated images will be requested.

How was it changed?

Changed the logic to additionally manage the uri arrays that are being processed/processed, and to avoid processing duplicate image uris that are already being processed.

[CLAassistant]

All committers have signed the CLA.

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[roubkar]

Hey @asynclee, thanks for opening this PR 🙌
I will review it shortly

[roubkar]

Hey @asynclee, could you please also update the CHANGELOG.md?

[asynclee]

Hello @roubkar. Sure. I'll update that.

[asynclee]

Hello, @roubkar. I wrote it based on what was written before, but I'm not sure if it's correct. Can you review it, please?

[roubkar]

Hello, @roubkar. I wrote it based on what was written before, but I'm not sure if it's correct. Can you review it, please?

For now, I'm not sure whether this will be released with v3.17.3 or v3.18.0.
If you don't mind I will adjust that part later

[roubkar]

LGTM

[roubkar]

Hey @asynclee, I just merged this PR.
Thanks for fixing this issue and congrats on your contribution 🎉