-
Notifications
You must be signed in to change notification settings - Fork 2.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Permission denied when trying to download NCDC data from S3 #30
Comments
Tried within an EC2 instance in us-east-1 region. |
tried it with emr cluster in us-east-1, looks like permission issue. aws cli command return following (snippet) |
It's a wilde guess but there is a most likely access is restricted to a AWS us-east-1 subnets on S3 GetObjects, because I can list objects with no issues. I assume bucket policy has restrictions on us-east-1 ip range. Latest us-east-1 public ip range available here: curl https://ip-ranges.amazonaws.com/ip-ranges.json | jq '.prefixes[] | select(.service | contains("EC2")) | select(.region | contains("us-east-1"))' |
Remove me from this list.
From: Bruno Moyle <notifications@github.com>
Sent: Saturday, July 11, 2020 12:50 PM
To: tomwhite/hadoop-book <hadoop-book@noreply.github.com>
Cc: Subscribed <subscribed@noreply.github.com>
Subject: Re: [tomwhite/hadoop-book] Permission denied when trying to download NCDC data from S3 (#30)
Closed #30 <#30> .
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub <#30 (comment)> , or unsubscribe <https://github.com/notifications/unsubscribe-auth/AFRQLMKOGKT2K2VMVZFL66DR3C65XANCNFSM4DH6NENA> . <https://github.com/notifications/beacon/AFRQLMMBKJ3ONZTAMGS6K43R3C65XA5CNFSM4DH6NENKYY3PNVWWK3TUL52HS4DFWZEXG43VMVCXMZLOORHG65DJMZUWGYLUNFXW5KTDN5WW2ZLOORPWSZGO2LFXQXQ.gif>
|
Hi.
I am trying do download the NCDC data from S3, as defined in:
http://hadoopbook.com/code.html
Got the following error:
The text was updated successfully, but these errors were encountered: