Skip to content

Investigate rclone bucket emptying delay #459

Open
@0x2b3bfa0

Description

@0x2b3bfa0
Member

This issue was solved by reverting partially the change the introduced the regression, but the exact causes are still unknown.

The bucket emptying method introduced with #420 returns almost immediately, but files take a few minutes more to disappear. I suspect that rclone is using some trickery to empty the bucket in the server side (e.g. expiration time) and returns as soon as the deletion begins.

Can be reproduced with v0.10.0 in a storage.workdir filled with files:

mkdir --parents stress/{1..10}/{1..10}/{1..10}
yes | head | tee stress/{1..10}/{1..10}/{1..10}/file

Activity

changed the title [-]Investigate #452 & #453[/-] [+]Investigate `rclone` bucket emptying delay[/+] on Mar 24, 2022
self-assigned this
on Mar 24, 2022
linked a pull request that will close this issue on Mar 30, 2022
casperdcl

casperdcl commented on Mar 31, 2022

@casperdcl
Contributor

I just got #452 on v0.10.0 despite having just 1 file (no folders) to sync (fixed by v0.10.3)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

    Development

    Participants

    @casperdcl@0x2b3bfa0

    Issue actions

      Investigate `rclone` bucket emptying delay · Issue #459 · iterative/terraform-provider-iterative