Skip to content
Script to copy an AWS S3 Bucket to another bucket using many threads in Python
Python
Find file
Latest commit e3f827b @paultuckey Merge pull request #7 from mihaibogdan10/master
Implemented option to set dest path thanks mihaibogdan10

README.md

s3_bucket_to_bucket_copy.py

Script to copy all files (or files with given prefix) from an AWS S3 Bucket in one region to another bucket in a different region using many threads in Python.

Add a file, .s3cfg, to your home directory with the following format (or download s3cmd and run "s3cmd --configure"):

[default]
access_key = <your access key here>
secret_key = <your secret key here>

Then run:

s3_bucket_to_bucket_copy.py <source_bucket_name>[/<prefix>] <dest_bucket_name> 

Note, For OSX users, make sure the Python boto package is installed:

sudo easy_install boto
pip install -U boto

When dealing with a very large number of files, you might want to try to use more worker threads:

s3_bucket_to_bucket_copy.py <source_bucket_name>[/<prefix>] <dest_bucket_name> -t 100

Developed by us guys at Showcase Workshop.

Other Contributors:

Something went wrong with that request. Please try again.