-
Notifications
You must be signed in to change notification settings - Fork 175
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Moves the S3 sink bucket configuration to the root configuration #2759
Moves the S3 sink bucket configuration to the root configuration #2759
Conversation
Codecov Report
@@ Coverage Diff @@
## main #2759 +/- ##
============================================
+ Coverage 94.12% 94.14% +0.01%
+ Complexity 2441 2440 -1
============================================
Files 278 278
Lines 6744 6744
Branches 551 551
============================================
+ Hits 6348 6349 +1
+ Misses 256 254 -2
- Partials 140 141 +1 |
@@ -29,8 +29,10 @@ public class S3SinkConfig { | |||
|
|||
@JsonProperty("bucket") | |||
@NotNull |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should we add a min validation here to prevent against empty strings?
void get_bucket_option_test() { | ||
assertThat(new S3SinkConfig().getBucketOptions(), equalTo(null)); | ||
void get_bucket_name_test() { | ||
assertThat(new S3SinkConfig().getBucketName(), equalTo(null)); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
bucketName has a nonNull validation on it. Let's make this test be more realistic.
@@ -263,7 +260,7 @@ void test_output_with_uploadedToS3_success_records_byte_count() throws IOExcepti | |||
|
|||
@Test | |||
void test_output_with_uploadedToS3_failed() throws IOException { | |||
when(s3SinkConfig.getBucketOptions().getBucketName()).thenReturn(null); | |||
when(s3SinkConfig.getBucketName()).thenReturn(null); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can we use a random string here? We should be using realistic values. Same is true for test_retryFlushToS3_negative
Signed-off-by: David Venable <dlv@amazon.com>
Signed-off-by: David Venable <dlv@amazon.com>
c74df77
to
54ed709
Compare
Description
This moves the S3 bucket configurations to simplify the YAML.
New configuration:
Old configuration:
Issues Resolved
N/A
Check List
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.