Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Improve][Connector-V2][JDBC] Add exactly-once for JDBC source connector #3750

Merged
merged 8 commits into from
Dec 26, 2022

Conversation

TaoZex
Copy link
Contributor

@TaoZex TaoZex commented Dec 17, 2022

Purpose of this pull request

#3725
Add exactly-once for JDBC source connector

Check list

@TaoZex TaoZex marked this pull request as ready for review December 17, 2022 12:24
@TaoZex TaoZex marked this pull request as draft December 17, 2022 13:22
@TaoZex TaoZex marked this pull request as ready for review December 17, 2022 14:55
@TyrantLucifer
Copy link
Member

Please do integration test and veirfy the pull request is work.

@TaoZex TaoZex closed this Dec 17, 2022
@TaoZex TaoZex reopened this Dec 17, 2022
@liugddx
Copy link
Member

liugddx commented Dec 18, 2022

A test case can be provided after #3637 .

@TaoZex
Copy link
Contributor Author

TaoZex commented Dec 18, 2022

A test case can be provided after #3637 .

Thanks.

@TaoZex TaoZex marked this pull request as draft December 18, 2022 07:34
@TaoZex TaoZex closed this Dec 18, 2022
@TaoZex TaoZex reopened this Dec 18, 2022
Copy link
Member

@Hisoka-X Hisoka-X left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

this.enumeratorContext = enumeratorContext;
this.jdbcSourceOptions = jdbcSourceOptions;
this.partitionParameter = partitionParameter;
this.pendingSplits = new HashMap<>();
this.shouldEnumerate = sourceState == null;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
this.shouldEnumerate = sourceState == null;
if (sourceState == null) {
this.shouldEnumerate = true;
} else {
this.shouldEnumerate = false;
}

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
this.shouldEnumerate = sourceState == null;
this.shouldEnumerate = sourceState == null ? true : false;

How about using this way?

@EricJoy2048 EricJoy2048 merged commit 5328e9d into apache:dev Dec 26, 2022
lhyundeadsoul pushed a commit to lhyundeadsoul/incubator-seatunnel that referenced this pull request Jan 3, 2023
…tor (apache#3750)

* [Improve][Connector-V2][JDBC] Add exactly-once for JDBC source connector
lhyundeadsoul pushed a commit to lhyundeadsoul/incubator-seatunnel that referenced this pull request Jan 3, 2023
…tor (apache#3750)

* [Improve][Connector-V2][JDBC] Add exactly-once for JDBC source connector
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

6 participants