RemoteLogDownloader cannot perform concurrent downloads

[swuferhong]

Search before asking

• I searched in the issues and found nothing similar.

Fluss version

0.7.0 (latest release)

Please describe the bug 🐞

In the design, we intended RemoteLogDownloader to concurrently download multiple remote files, controlled by the client.scanner.remote-log.prefetch-num parameter. However, in RemoteLogDownloader#fetchOnce(), only one fsPathAndFileName is currently passed to RemoteFileDownloader per iteration. Additionally, since RemoteFileDownloader operates synchronously here, this implementation causes RemoteLogDownloader to degenerate into a synchronous download mode.

Solution

No response

Are you willing to submit a PR?

• I'm willing to submit a PR!