Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BEAM-6010] Deprecate KafkaIO withTimestampFn(). #6964

Merged
merged 1 commit into from Nov 7, 2018

Conversation

rangadi
Copy link
Contributor

@rangadi rangadi commented Nov 6, 2018

TimestampPolicyFactory.withTimestampFn() was never meant to be public. It was a mistake on my part not to make package private when I first added it. It was included only to existing legacy API in KafkaIO.Read (also deprecated). This policy is too simplistic (sets watermark to most recent record timestamp) and almost always wrong. There is a better alternative.

@rangadi
Copy link
Contributor Author

rangadi commented Nov 6, 2018

+R: @jbonofre, @aromanenko-dev

Copy link
Contributor

@aromanenko-dev aromanenko-dev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, LGTM!

Btw, there is a bunch of deprecated API methods in KafkaIO (like withTimestampFn2() and etc) that were deprecated several releases ago. Any plans to remove them in the future?

@aromanenko-dev aromanenko-dev changed the title Deprecate KafkaIO withTimestampFn(). [BEAM-6010] Deprecate KafkaIO withTimestampFn(). Nov 7, 2018
@aromanenko-dev aromanenko-dev merged commit ba5bc60 into apache:master Nov 7, 2018
@rangadi
Copy link
Contributor Author

rangadi commented Nov 7, 2018

Thanks for merging this.
We can remove the deprecated API in KafkaIO. I was wondering if we should do that now or for 3.0. If you agree, I can send a PR right away to remove them. They have been deprecated for quite a while.

@aromanenko-dev
Copy link
Contributor

aromanenko-dev commented Nov 8, 2018

Yes, I'm agree, but before final removing this I'd wonder if Beam has any internal rules about that?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants