Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Github-issue#1048 : s3-sink with local-file buffer implementation. #2

Closed
wants to merge 5 commits into from

Conversation

deepaksahu562
Copy link
Owner

Description

  • Implementation of s3-sink local-file buffer functionality.

Issues Resolved

GitHub-issue opensearch-project#1048

Check List

  • New functionality includes testing.
  • New functionality has been documented.
    • New functionality has javadoc added
  • Commits are signed with a real name per the DCO

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

deepaksahu562 and others added 5 commits May 2, 2023 23:05
Signed-off-by: Deepak Sahu <deepak.sahu562@gmail.com>
* Add Tail Sampler action to aggregate processor

Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

* Added documentation and made change to cleanup state after wait period

Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

* Addressed review comments. Added AggregateActionOutput class

Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

* Introduced customShouldConclude check for adding custom conclusion checks

Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

* Updated documentation

Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

* Add AggregateActionOutput

Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

* Fix javadoc errors

Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

---------

Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>
… to be iterative instead of recursive (opensearch-project#2605)

* Log clear messages when OpenSearch Sink fails to push. Modify retries to be iterative instead of recursive

Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

* Addressed review comment. Fixed off-by-one error in the retry count

Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

* Fixed code to address failing integration tests

Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

* Fixed code to address failing tests

Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>

---------

Signed-off-by: Krishna Kondaka <krishkdk@amazon.com>
Signed-off-by: Deepak Sahu <deepak.sahu562@gmail.com>
@deepaksahu562
Copy link
Owner Author

Closing this PR in favor of opensearch-project#2645

@deepaksahu562 deepaksahu562 deleted the s3-sink-temp_file branch May 9, 2023 09:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants