Skip to content

refactor: Hudi Flink source v2 with better context management#18269

Merged
danny0405 merged 1 commit intoapache:masterfrom
HuangZhenQiu:flink-hudi-source-refactor
Mar 4, 2026
Merged

refactor: Hudi Flink source v2 with better context management#18269
danny0405 merged 1 commit intoapache:masterfrom
HuangZhenQiu:flink-hudi-source-refactor

Conversation

@HuangZhenQiu
Copy link
Collaborator

@HuangZhenQiu HuangZhenQiu commented Mar 3, 2026

Describe the issue this Pull Request addresses

Refactor Hudi Flink source v2 with better context management

Summary and Changelog

  1. Construct metadata client in DefaultHoodieSplitDiscover and HoodieSplitReaderFunction
  2. Reuse internal schema manager from Hudi table source.
  3. Updated corresponding test cases.

Impact

none

Risk Level

none

Documentation Update

none

Contributor's checklist

  • Read through contributor's guide
  • Enough context is provided in the sections above
  • Adequate tests were added if applicable

@github-actions github-actions bot added the size:M PR with lines of changes in (100, 300] label Mar 3, 2026
@HuangZhenQiu HuangZhenQiu force-pushed the flink-hudi-source-refactor branch from 60d53e1 to 1096099 Compare March 3, 2026 06:04
@HuangZhenQiu HuangZhenQiu force-pushed the flink-hudi-source-refactor branch from 1096099 to 0f303f8 Compare March 3, 2026 17:19
@codecov-commenter
Copy link

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 57.25%. Comparing base (43d8ed8) to head (0f303f8).

Additional details and impacted files
@@            Coverage Diff            @@
##             master   #18269   +/-   ##
=========================================
  Coverage     57.25%   57.25%           
- Complexity    18601    18603    +2     
=========================================
  Files          1948     1948           
  Lines        106690   106690           
  Branches      13196    13196           
=========================================
+ Hits          61084    61085    +1     
- Misses        39846    39847    +1     
+ Partials       5760     5758    -2     
Flag Coverage Δ
hadoop-mr-java-client 45.25% <ø> (+0.04%) ⬆️
spark-java-tests 47.42% <ø> (+0.01%) ⬆️
spark-scala-tests 45.52% <ø> (-0.01%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.
see 14 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@hudi-bot
Copy link
Collaborator

hudi-bot commented Mar 3, 2026

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

@danny0405 danny0405 merged commit 365398a into apache:master Mar 4, 2026
72 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:M PR with lines of changes in (100, 300]

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants