remote: base: walk_files might take a long time for big external directory

[efiop]

Better not forget to use progress bars when using walk_files. E.g. import-url s3://bucket/dir(same as run -d s3://bucket/dir and stuff like that)

[Suor]

Or should we walk files while copying/importing them?

[efiop]

@Suor Not always. For example, _collect_dir is needed for checking if something has changed, so no copying/importing is happening. The recently introduced download logic could indeed do that, though.

[Suor]

When walking is the whole operation when showing pbar for that is a no-brainer. When collecting files is just a prerequisite to actual work then two consequential pbars is a questionable UI.

Another thing is that with walking we can't really show progress, since we don't know the number of files. We can, however, show a number of files found, this might be enough for a user if he or she knows an approximate number. And even if not at least some speed will be shown.

[efiop]

Closing as stale. This will be revisited during fs/ui/events development in the near future.