Batch file downloads should start after each individual simulation is complete

[gvnwst]

This is a ~feature request related to recent work done by @jewettaijfc in #2648, #2647, and #2600.
When running a large batch, particularly when the simulations are fast, I find that the time to download results is a substantial fraction of the total time time (from submission -> results on local machine).

Is it possible to have results files begin to download as soon as an individual simulation completes? From my end it looks like each simulation is handled independently server-side, so I can interact with a completed simulation through the web GUI while others in the batch run... but it may be tricky to having a single python kernel manage server interactions to monitor batch progress and simultaneously download?

[yaugenst-flex]

Thanks for the suggestion @gvnwst! Agree there’s room to improve the batch experience here. We’re going to look into downloading each member as soon as it finishes, and it actually ties in nicely with the lazy-loading work @marcorudolphflex has done recently.

[yaugenst-flex]

Closing as this feature was just merged! Simulations in a batch are now downloaded asynchronously, which should speed things up! In principle they can also be loaded independently before the whole batch finishes, but you‘ll have to do some bookkeeping yourself in that case.