suggestion to speed up pvc transfer

[mariosevic]

A small suggestion on how Korb could be a lot faster: create a tar.gz file on the source PVC, move it to the destination, and then extract it. This method would significantly improve the speed.

[penumbra23]

++

[BeryJu]

with a tgz it might reduce speed actually with the additional compression, however a raw tar file would probably make things faster.

However the issue with this approach is that we'd need to have enough free space on the source PV and the target PV for the archive and the data, which the current solution does not require

[bmuruga1]

We had a recent issues in using the korb, where there are millions of files in the Source PVC.
strategy=copy-twice-name took more than 12 -14 hours and failing often with timeouts.

However export and import completed faster (tar option)

So introducing a new strategy (copy_twice_with_tar_pipe) tar to a pipe and extract in a single command line will be helpful and make it faster (Good old unix backup days).

This will not introduce any extra space consumption in the PVC also.

tar cfvz - /source | tar xfvz - -C /Dest

This will avoid the unnecessary space usage on the admin host for the export and import option