Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Not able to use gsutil rsync to sync local dir to s3 bucket #1738

Open
dineshkumar3234 opened this issue Aug 29, 2023 · 1 comment
Open

Not able to use gsutil rsync to sync local dir to s3 bucket #1738

dineshkumar3234 opened this issue Aug 29, 2023 · 1 comment

Comments

@dineshkumar3234
Copy link

dineshkumar3234 commented Aug 29, 2023

ubuntu@newhost:~/data$ gsutil -m rsync -r global s3://ax-global
**CommandException: The rsync command requires at least 2 arguments. Usage:

gsutil rsync [OPTION]... src_url dst_url**

For additional help run:
gsutil help rsync
ubuntu@newhost:~/data$

i am able to list the buckets folder with gsutil ls s3://ax-global

Used cmd:
gsutil -m rsync -r global s3://ax-global
gsutil -m rsync -ri global s3://ax-global
gsutil rsync -r global s3://ax-global
gsutil rsync global s3://ax-global
gsutil rsync ./global s3://ax-global
gsutil -m rsync -r ./global s3://ax-global/
gsutil rsync ./global s3://ax-global/

@adamsh231
Copy link

adamsh231 commented Sep 12, 2023

i got this error too with similar case with you

my command

gsutil -m rsync -r s3://my-source-bucket gs://my-destination-bucket

got similar error above (**CommandException: The rsync command requires at least 2 arguments. Usage: xxx)

i tried to check whats wrong with the rsync command argument, so i tried to sync my local directory in order to check my argument with this command

gsutil -m rsync -r /home/{user}/test/ gs://my-destination-bucket

its running well

so i try again once more with spesific folder img but this time with bucket

gsutil -m rsync -r s3://my-source-bucket/img gs://my-destination-bucket

and gotcha it worked

so i try to add slash, you may add /. it will be s3://my-source-bucket/ not s3://my-source-bucket

gsutil -m rsync -r s3://my-source-bucket/ gs://my-destination-bucket

Hope this helps

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants