Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] faster deletion : on the fly deletion of each page #164

Closed
jlamande opened this issue Apr 6, 2024 · 3 comments · Fixed by #168
Closed

[Feature] faster deletion : on the fly deletion of each page #164

jlamande opened this issue Apr 6, 2024 · 3 comments · Fixed by #168
Labels
enhancement New feature or request feature request Feature request

Comments

@jlamande
Copy link

jlamande commented Apr 6, 2024

Is your feature request related to a problem? Please describe.
Faster deletion and less memory consumption

Describe the solution you'd like

Currently when cleaning up, the first step seems to be necessarily to list all objects.

This takes time and consumes memory.

For buckets with millions of objects this is not efficient or doable without retries.

Would it be possible to avoid listing all objects of the bucket and launch a deletion on each page ?

The progress bar could only display the number of objects deleted so far but without ratio on a total.

Additional context

Add any other context or screenshots about the feature request here.

@jlamande jlamande added the feature request Feature request label Apr 6, 2024
@jlamande jlamande changed the title [Feature] faster deletion of each page [Feature] faster deletion : on the fly deletion of each page Apr 6, 2024
@go-to-k
Copy link
Owner

go-to-k commented Apr 6, 2024

Thanks for the request.
That's right. I had originally considered making that change as well.
I may need to make some large changes to the handling, which may take a bit of time, but I'll look into it.

@go-to-k
Copy link
Owner

go-to-k commented Apr 15, 2024

@jlamande

I took this issue, and have released a new version v0.16.0 that includes this feature! Please use it if you like.

@jlamande
Copy link
Author

Great ! I’ll test it asap

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request feature request Feature request
Projects
None yet
2 participants