Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot download NAIP images on s3 using boto #77

Closed
andrewjavao opened this issue Feb 24, 2017 · 3 comments
Closed

Cannot download NAIP images on s3 using boto #77

andrewjavao opened this issue Feb 24, 2017 · 3 comments

Comments

@andrewjavao
Copy link

I‘ve configurated s3cfg, and i can download naip image via s3cmd fine, but when running bin/create_training_data.py, it ends up 403 error when downloading naip images.

@andrewljohnson
Copy link
Contributor

That sounds like when running s3cmd within the Docker/script, your credentials are not being used.

Did you export your AWS credentials per the README?

@andrewjavao
Copy link
Author

andrewjavao commented Feb 27, 2017

I put the credentials into .s3cfg file right way inside the container, without setting docker container's environment parameter.
Maybe that is the problem, I'll try. I saw naip_images.py overwrites AWS credentials in .s3cfg with env-value in function configure_s3cmd(). Since I can download via s3cmd inside the container, so I modified the downloading code a little bit myself(just for debugging), I comment out boto client and os.system(s3cmd) to do the downloading. Though this works for me, but I'll try to setting up per the README, and make this issue clear.

@andrewjavao
Copy link
Author

I followed the README, and export AWS credentials before runing the container and it works just fine. My bad.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants