Please sign in to comment.
s3cmd du can gobble gigs of RAM on a bucket with millions of objects.
Re-worked 'du' to traverse the structure and store only the sum at each level, allowing python to free memory at each folder. Went from 4GB consumption (and being killed) on a test bucket with ~50M objects in thousands of directories, to a max of 80M usage.
- Loading branch information...