Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates to S3 Glacier auto retrieval #3680

Merged
merged 2 commits into from
Feb 27, 2023
Merged

Conversation

bentsherman
Copy link
Member

Based on discussions with Michael Kroell about the Glacier auto retrieval. See this AWS documentation for context.

  • Don't specify expiration days if storage class is intelligent tiering (otherwise the restore will fail)
  • Add glacierRetrievalTier config option (Standard, Expedited, Bulk)

- Don't specify expiration days if storage class is intelligent tiering
- Add glacierRetrievalTier config option

Signed-off-by: Ben Sherman <bentshermann@gmail.com>
@pditommaso
Copy link
Member

Nice, has been tested?

Signed-off-by: Ben Sherman <bentshermann@gmail.com>
@pditommaso
Copy link
Member

@bentsherman 👉 #3680 (comment)

@bentsherman
Copy link
Member Author

I was able to test the glacier retrieval tier and it worked.

I don't know how to test the check for Intelligent Tiering. I created a file in S3 with storage class set to Intelligent Tiering, but according to AWS docs the file is archived only after 90 days. Until then, the file can be accessed like a normal S3 object.

@pditommaso
Copy link
Member

Ok, nice

@pditommaso pditommaso merged commit fab6bd5 into master Feb 27, 2023
@pditommaso pditommaso deleted the ben-s3-glacier-restore-2 branch February 27, 2023 21:43
abhi18av pushed a commit to abhi18av/nextflow that referenced this pull request Oct 28, 2023

Signed-off-by: Ben Sherman <bentshermann@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants