Skip to content

[Feature] [cdc] Avoid sending empty schema change events to Schema Evolution #7260

@juntaozhang

Description

@juntaozhang

Search before asking

  • I searched in the issues and found nothing similar.

Motivation

RichEventParser.parseSchemaChange() always returns a CdcSchema object even when there is no actual schema change. This causes empty schema change events to be sent to the Schema Evolution operator via side output, resulting in unnecessary network overhead and processing.

Image

Solution

Return null from parseSchemaChange() when there is no schema change (no field changes and no comment changes). This is consistent with RichCdcMultiplexRecordEventParser which already returns null when the table
should not be synchronized.

Anything else?

after optimize:
Image

Are you willing to submit a PR?

  • I'm willing to submit a PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions