Skip to content
This repository has been archived by the owner on Feb 9, 2021. It is now read-only.

Is s3a support AWS SSE-KMS encryption while uploading data from hdfs to s3? #13

Closed
error804 opened this issue Oct 7, 2015 · 3 comments

Comments

@error804
Copy link

error804 commented Oct 7, 2015

Hi,

We are trying to upload data to s3 destination with file that need to be encrypted with SSE-KMS keys. Does the s3a file system implementaion support this?

We were able to copy SSE-KMS encypted files from the s3 bucket to AWS EMR cluster's HDFS using command:-

hadoop fs -cp s3a://bucketName/data/ hdfs://testip/user/hdfs/

But we were unable to copy files from EMR cluster's HDFS to s3 bucket with AWS SSE-KMS encryption. Does it also support multipart-file upload?

Hope to hear from you soon,
error804.

@error804
Copy link
Author

Thanks,

Finally we were able to copy data from s3 to hdfs and hdfs to s3 with SSE-KMS encryption.

Regards,
error804.

@fedecz
Copy link

fedecz commented May 18, 2016

hey @error804 , may I ask you how were you able to copy data to/from S3a/hdfs using SSE-KMS ? Thanks

Fede

@error804
Copy link
Author

Modified some of the github code to add encryption

On Wednesday, May 18, 2016, Federico Czerwinski notifications@github.com
wrote:

hey @error804 https://github.com/error804 , may I ask you how were you
able to copy data to/from S3a/hdfs using SSE-KMS ? Thanks

Fede


You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub
#13 (comment)

@error804

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants