Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Enhancement] Support to configure whether to use transaction stream load for at-least-once #228

Merged
merged 2 commits into from
Jun 8, 2023

Conversation

banmoy
Copy link
Collaborator

@banmoy banmoy commented May 18, 2023

What type of PR is this:

  • BugFix
  • Feature
  • Enhancement
  • Refactor
  • UT
  • Doc
  • Tool

Which issues of this PR fixes :

Fixes #

Problem Summary(Required) :

Transaction stream load is not always perfect for at-least-once. For example, it will open a long-running transaction, and is more easy to reach the limit of the max running transactions. So provide an option to use the normal stream load for at-least-once.

Checklist:

  • I have added test cases for my bug fix or my new feature
  • This pr will affect users' behaviors
  • This pr needs user documentation (for new or modified features or behaviors)
  • I have added documentation for my new feature or new function

…east-once

Signed-off-by: PengFei Li <lpengfei2016@gmail.com>
@banmoy banmoy changed the title [Enhancement] at-least-once don't use transaction stream load by default [Enhancement] Support to configure whether to use transaction stream load for at-least-once Jun 8, 2023
@banmoy banmoy merged commit 692d7eb into StarRocks:main Jun 8, 2023
2 of 4 checks passed
banmoy added a commit to banmoy/starrocks-connector-for-apache-flink that referenced this pull request Aug 28, 2023
…load for at-least-once (StarRocks#228)

[Enhancement] Support whether to use transaction stream load for at-least-once

Signed-off-by: PengFei Li <lpengfei2016@gmail.com>
banmoy added a commit to banmoy/starrocks-connector-for-apache-flink that referenced this pull request Aug 28, 2023
…load for at-least-once (StarRocks#228)

[Enhancement] Support whether to use transaction stream load for at-least-once

Signed-off-by: PengFei Li <lpengfei2016@gmail.com>
banmoy added a commit that referenced this pull request Sep 11, 2023
…load for at-least-once (#228)

[Enhancement] Support whether to use transaction stream load for at-least-once

Signed-off-by: PengFei Li <lpengfei2016@gmail.com>
banmoy added a commit that referenced this pull request Sep 11, 2023
…load for at-least-once (#228)

[Enhancement] Support whether to use transaction stream load for at-least-once

Signed-off-by: PengFei Li <lpengfei2016@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants