-
Notifications
You must be signed in to change notification settings - Fork 8.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
HADOOP-17480. Document that AWS S3 is consistent and that S3Guard is not needed #2636
HADOOP-17480. Document that AWS S3 is consistent and that S3Guard is not needed #2636
Conversation
…not needed Change-Id: I2b1c2aa16205cf39cb271bf8ea348ee287530d97
💔 -1 overall
This message was automatically generated. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me.
How to move off S3Guard, given it is no longer needed. | ||
|
||
1. Unset the option `fs.s3a.metadatastore.impl` globally/for all buckets for which it | ||
was selected. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Would be nice to remind people to delete those S3Guard DynamoDB tables as provisioned IPOS will still cost money. I think we can also use the s3guard command line tool to destroy, e.g. hadoop s3guard destroy s3a://guarded-table/
.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
once you remove the s3guard settings it becomes harder to work out the table to destroy, you need to use dynamodb URLs. Easiest just to use the console, especially as it lets you see if there are any orphan tables around.
…not needed (#2636) Contributed by Steve Loughran. Change-Id: I775e3ee7b60665240ec621859c337b053f747a49
… S3Guard is not needed (apache#2636) Contributed by Steve Loughran. Change-Id: I775e3ee7b60665240ec621859c337b053f747a49
won't happen any more