Skip to content

[FLINK-39312][pipeline][HUDI] Fix Hudi connector packaging to include…#4332

Merged
lvyanquan merged 2 commits intoapache:masterfrom
cshuo:FLINK-39312
Mar 24, 2026
Merged

[FLINK-39312][pipeline][HUDI] Fix Hudi connector packaging to include…#4332
lvyanquan merged 2 commits intoapache:masterfrom
cshuo:FLINK-39312

Conversation

@cshuo
Copy link
Contributor

@cshuo cshuo commented Mar 24, 2026

flink-metrics-dropwizard dependency

Describe the issue this Pull Request addresses

The Hudi pipeline connector declared flink-metrics-dropwizard with test scope in its module pom.xml, which restricted the dependency to test classpaths only, and leads to the failure of job, like:

Caused by: java.lang.NoClassDefFoundError: org/apache/flink/dropwizard/metrics/DropwizardMeterWrapper
at org.apache.hudi.metrics.FlinkStreamWriteMetrics.<init>(FlinkStreamWriteMetrics.java:91) 
at org.apache.hudi.sink.StreamWriteFunction.registerMetrics(StreamWriteFunction.java:457) 
at org.apache.hudi.sink.StreamWriteFunction.open(StreamWriteFunction.java:164) 

This PR removes that scope restriction so the dependency is resolved as a regular module dependency, aligning packaging/classpath behavior for non-test builds and runtime usage of the connector.

Summary and Changelog

  • Removed <scope>test</scope> from dependency org.apache.flink:flink-metrics-dropwizard:${flink.version}.
  • No logic changes; this is a dependency-scope adjustment only.

@cshuo
Copy link
Contributor Author

cshuo commented Mar 24, 2026

I found a blocking bug in hudi pipeline connector, can you help review and land. cc @lvyanquan

Copy link
Contributor

@lvyanquan lvyanquan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@lvyanquan lvyanquan merged commit 723615b into apache:master Mar 24, 2026
37 of 38 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants