We should improve the way we fetch the blobs infos from the remote.
Right now we are processing all the body and parse each chunks while accumulating blob infos in a queue. Which can use a lot of RAM if the reader is not enough fast to consume the queue. We should keep be able to fetch and parse the results in // while reading them.
We should improve the way we fetch the blobs infos from the remote.
Right now we are processing all the body and parse each chunks while accumulating blob infos in a queue. Which can use a lot of RAM if the reader is not enough fast to consume the queue. We should keep be able to fetch and parse the results in // while reading them.