Backblaze B2 bucket file listing speed regression

[Cherry]

Describe the bug

Since version 8.5.8, listing files in large Backblaze B2 buckets is SIGNIFICANTLY slower. A bucket that would previous take a few seconds to load, now takes over 20x that. It appears to be caused by the changes in the following PR, listing files in every folder. During my testing, some of these folders have thousands of files in them. #14431

To Reproduce

Steps to reproduce the behavior:

• Create a bucket in B2 with tens of thousands of "directories" and files
• Browse around the bucket in Cyberduck 8.5.9 vs the previous 8.5.7

Expected behavior

• Listing bucket files contents should be as fast as it was in prior versions

Logs

I enabled debug logging to try and get an idea about how many requests were made. I then simply connected to B2, and expanded the root of the bucket.

8.5.9

Time Taken: ~120s
Number of times B2FileInfoResponse is in log file: >20,0000
Total debug log size: 81,508 KB

8.5.7

Time Taken: ~3s
Number of times B2FileInfoResponse is in log file: 131
Total debug log size: 70 KB

If there is any further debug I can do, please let me know.

Versions

• OS: Windows 10 Pro 22H2
• Cyberduck: 8.5.9 (39636), and tested on 8.5.7 (39535)

[Aenigma]

I'm experiencing this in 8.5.9 as well after updating from 8.5.7. Some of my b2 buckets with large folder hierarchies containing about 15k files effectively just loads forever.

[syneryder]

Another +1, though I wouldn't describe it as just a "speed regression", as it has taken Cyberduck 8.5.9 10 minutes to list the root directory of a B2 bucket - and the root directory only has 9 folders and zero files.

10 minutes for every Backblaze B2 folder list command makes Cyberduck completely unusable.

8.5.7 works fine, but the new behavior occurred in 8.5.8 and continues in 8.5.9. I'll need to downgrade back to Cyberduck 8.5.7 until resolved.

[dkocher]

This is resolved in the current snapshot and beta builds.