Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Cherry-pick] Pass client builder to debezium database history #12112

Merged
merged 2 commits into from
Jan 25, 2022

Conversation

Technoboy-
Copy link
Contributor

Cherry pick #11293

Motivation

The Debezium requires pulsar a service URL for history database usage.

In #11056 , the service.url field from PulsarKafkaWorkerConfig is no longer available. And the value is also deleted from multiple yaml config files in this commit. This causes the integration test for Debezium connector to fail.

Based on the Debezium paradigm, all configurations should be passed as strings. There's no easy way to inject a PulsarClient via configuration.

We need to ask user to provide the pulsar url explicitly and probably auth info also.

Modifications

Make the database.history.pulsar.service.url field required
Add the config value back to example yaml files
Update the integration test config

@Technoboy-
Copy link
Contributor Author

This pr is a little different with the original one.
Original SourceContext extends ConnectorContext
But this or make it extends : SourceContext extends Context

@Technoboy- Technoboy- changed the title [Cherry-pick] Pass client builder to debezium database history [Cherry-pick & WIP] Pass client builder to debezium database history Sep 21, 2021
Copy link
Contributor

@eolivelli eolivelli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@Technoboy-
Copy link
Contributor Author

/pulsarbot run-failure-checks

@Anonymitaet Anonymitaet added the doc-not-needed Your PR changes do not impact docs label Sep 22, 2021
@Technoboy- Technoboy- changed the title [Cherry-pick & WIP] Pass client builder to debezium database history [Cherry-pick] Pass client builder to debezium database history Sep 24, 2021
@Technoboy-
Copy link
Contributor Author

/pulsarbot run-failure-checks

1 similar comment
@Technoboy-
Copy link
Contributor Author

/pulsarbot run-failure-checks

@codelipenghui codelipenghui merged commit ed771af into apache:branch-2.8 Jan 25, 2022
@codelipenghui codelipenghui added cherry-picked/branch-2.9 Archived: 2.9 is end of life cherry-picked/branch-2.8 Archived: 2.8 is end of life and removed cherry-picked/branch-2.9 Archived: 2.9 is end of life labels Jan 25, 2022
@Technoboy- Technoboy- deleted the cherry-pick-11293 branch August 10, 2022 05:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connector cherry-picked/branch-2.8 Archived: 2.8 is end of life doc-not-needed Your PR changes do not impact docs release/2.8.3
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants