Skip to content

Fix Flink connector Kafka test dependencies#17836

Merged
xiangfu0 merged 1 commit intoapache:masterfrom
xiangfu0:fixing-flink-test
Mar 9, 2026
Merged

Fix Flink connector Kafka test dependencies#17836
xiangfu0 merged 1 commit intoapache:masterfrom
xiangfu0:fixing-flink-test

Conversation

@xiangfu0
Copy link
Contributor

@xiangfu0 xiangfu0 commented Mar 9, 2026

Summary

Follow up to fix test failure for #17790

  • add the Kafka embedded-cluster test jar to the Flink connector test classpath
  • add the Kafka test classifier artifacts required by EmbeddedKafkaCluster
  • fix PinotSinkUpsertTableIntegrationTest failing with NoClassDefFoundError for EmbeddedKafkaCluster

Testing

  • ./mvnw -pl pinot-connectors/pinot-flink-connector -Dtest=PinotSinkUpsertTableIntegrationTest -Dsurefire.failIfNoSpecifiedTests=false test

@xiangfu0 xiangfu0 added dependencies Pull requests that update a dependency file testing labels Mar 9, 2026
@xiangfu0 xiangfu0 requested a review from Copilot March 9, 2026 00:03
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR fixes the Flink connector’s integration test runtime by adding the Kafka embedded-cluster test artifacts required for EmbeddedKafkaCluster to be available on the test classpath.

Changes:

  • Add pinot-kafka-3.0 test-jar to the Flink connector test dependencies so EmbeddedKafkaCluster is present.
  • Add Kafka test classifier artifacts (kafka_${scala.compat.version}, kafka-clients, kafka-server-common) required by the embedded cluster test utilities.

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 1 out of 1 changed files in this pull request and generated no new comments.

@codecov-commenter
Copy link

codecov-commenter commented Mar 9, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 63.27%. Comparing base (b280619) to head (057f896).
⚠️ Report is 1 commits behind head on master.

Additional details and impacted files
@@             Coverage Diff              @@
##             master   #17836      +/-   ##
============================================
+ Coverage     55.58%   63.27%   +7.69%     
- Complexity      727     1466     +739     
============================================
  Files          2497     3190     +693     
  Lines        141225   191963   +50738     
  Branches      22529    29410    +6881     
============================================
+ Hits          78499   121469   +42970     
- Misses        56072    60985    +4913     
- Partials       6654     9509    +2855     
Flag Coverage Δ
custom-integration1 100.00% <ø> (ø)
integration 100.00% <ø> (ø)
integration1 100.00% <ø> (ø)
integration2 0.00% <ø> (ø)
java-11 63.22% <ø> (+7.68%) ⬆️
java-21 63.23% <ø> (+7.67%) ⬆️
temurin 63.27% <ø> (+7.69%) ⬆️
unittests 63.27% <ø> (+7.69%) ⬆️
unittests1 55.58% <ø> (+<0.01%) ⬆️
unittests2 34.26% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Add the Kafka embedded-cluster test jar and Kafka test classifier artifacts to the Flink connector test classpath so BaseClusterIntegrationTest can load EmbeddedKafkaCluster during PinotSinkUpsertTableIntegrationTest.
@xiangfu0 xiangfu0 force-pushed the fixing-flink-test branch from 1248b63 to 057f896 Compare March 9, 2026 01:12
@xiangfu0 xiangfu0 merged commit 23c9a59 into apache:master Mar 9, 2026
18 checks passed
@xiangfu0 xiangfu0 deleted the fixing-flink-test branch March 9, 2026 02:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file testing

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants