Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FLINK-8354] Add KafkaDeserializationSchema that directly uses ConsumerRecord #7781

Closed
wants to merge 3 commits into from
Closed

[FLINK-8354] Add KafkaDeserializationSchema that directly uses ConsumerRecord #7781

wants to merge 3 commits into from

Commits on Feb 21, 2019

  1. [FLINK-8354] Refactor AUTO_COMMIT config in Kafka consumers 

    This moves the code to a method in the base class.
    @alexey-tr @aljoscha
    alexey-tr authored and aljoscha committed Feb 21, 2019
    Copy the full SHA
    3764f2e View commit details
    Browse the repository at this point in the history

  2. [FLINK-8354] Fix formatting in FlinkKafkaConsumerBase

    @alexey-tr @aljoscha
    alexey-tr authored and aljoscha committed Feb 21, 2019
    Copy the full SHA
    4df2d91 View commit details
    Browse the repository at this point in the history

  3. [FLINK-8354] Add KafkaDeserializationSchema that uses ConsumerRecord 

    We now directly use the ConsumerRecord from the Kafka API instead of
trying to forward what we need to the deserialization schema ourselves.

This makes it more future-proof, if Kafka adds new fields to the
ConsumerRecord.

The previously used KeyedDeserializationSchema now extends
KafkaDeserializationSchema and has a default method to bridge the
interface. This way existing uses of KeyedDeserializationSchema still
work.
    @alexey-tr @aljoscha
    alexey-tr authored and aljoscha committed Feb 21, 2019
    Copy the full SHA
    d39c6c0 View commit details
    Browse the repository at this point in the history