New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
A try fixing Lambda persistence #8643
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hiding the LocalStack-internal Lambda S3 buckets makes sense 👍
@@ -64,6 +64,9 @@ | |||
SNAP_START_SUPPORTED_RUNTIMES = [Runtime.java11, Runtime.java17] | |||
|
|||
|
|||
BUCKET_ACCOUNT = "949334387222" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It would be helpful to add a comment clarifying that this is just some random account
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Will add!
@@ -64,6 +64,9 @@ | |||
SNAP_START_SUPPORTED_RUNTIMES = [Runtime.java11, Runtime.java17] | |||
|
|||
|
|||
BUCKET_ACCOUNT = "949334387222" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
✅ We don't get any conflicts in multi-account setups because the account_id
is used as namespace
@@ -64,6 +64,9 @@ | |||
SNAP_START_SUPPORTED_RUNTIMES = [Runtime.java11, Runtime.java17] | |||
|
|||
|
|||
BUCKET_ACCOUNT = "949334387222" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
semver:minor
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The recent cross-account enhancements as well, so good to batch them: 28427b9
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is actually a fix for that PR, as it broke persistence for remote fetched layers. Not exactly sure why currently, but it blocks the -ext pipeline.
@@ -64,6 +64,9 @@ | |||
SNAP_START_SUPPORTED_RUNTIMES = [Runtime.java11, Runtime.java17] | |||
|
|||
|
|||
BUCKET_ACCOUNT = "949334387222" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
"Hiding" LocalStack-internal lambda buckets basically addresses this question #8494
Motivation
With PR #8235 , the persistence tests broke.
It seems, that connecting to the bucket from different accounts, made some problems with remote fetched layers. It is not quite clear what causes this behavior (maybe some cross account problem in s3?), but it needs to be solved ASAP to unblock the pipeline.
Changes
@giograno