Skip to content

chore(spark): bump spark4.version to 4.0.2#18549

Merged
yihua merged 1 commit into
apache:masterfrom
voonhous:bump-to-spark4.0.2
Apr 23, 2026
Merged

chore(spark): bump spark4.version to 4.0.2#18549
yihua merged 1 commit into
apache:masterfrom
voonhous:bump-to-spark4.0.2

Conversation

@voonhous
Copy link
Copy Markdown
Member

Describe the issue this Pull Request addresses

Bumps the Spark 4 line from 4.0.1 to 4.0.2 to pick up the latest upstream patch release.

Summary and Changelog

  • pom.xml: <spark4.version> and <spark40.version> moved 4.0.1 -> 4.0.2.

Both properties feed the spark4.0 Maven profile, so all hudi-spark4.0.x / hudi-spark4-common compile + test paths and the matrix jobs test-spark-java17-java-tests-part[1-5] in .github/workflows/bot.yml now run against 4.0.2.

Bundle-validation workflow paths (validate-bundles-spark4*) are intentionally left alone. They still execute inside a Docker image that bakes in Spark 4.0.0 via IMAGE_TAG=flink1200hive313spark400scala213. Moving that requires publishing a new apachehudi/hudi-ci-bundle-validation-base tag on Docker Hub and is out of scope here.

Impact

No public API or user-facing change. Bundles will be built against Spark 4.0.2 instead of 4.0.1.

Risk Level

low

Property-only change. The spark4.0 profile resolves 4.0.2 artifacts from Maven Central. Covered by the existing test-spark-java17-java-tests-part[1-5] matrix.

Documentation Update

none

Contributor's checklist

  • Read through contributor's guide
  • Enough context is provided in the sections above
  • Adequate tests were added if applicable

@voonhous voonhous requested review from rahil-c and yihua April 22, 2026 11:24
@voonhous
Copy link
Copy Markdown
Member Author

Followup task:
#18548

@github-actions github-actions Bot added the size:XS PR with lines of changes in <= 10 label Apr 22, 2026
@codecov-commenter
Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 68.86%. Comparing base (0d57435) to head (0fe3194).

Additional details and impacted files
@@            Coverage Diff            @@
##             master   #18549   +/-   ##
=========================================
  Coverage     68.85%   68.86%           
- Complexity    28462    28464    +2     
=========================================
  Files          2475     2475           
  Lines        136580   136580           
  Branches      16613    16613           
=========================================
+ Hits          94041    94051   +10     
+ Misses        34977    34973    -4     
+ Partials       7562     7556    -6     
Flag Coverage Δ
common-and-other-modules 44.47% <ø> (+<0.01%) ⬆️
hadoop-mr-java-client 44.79% <ø> (+0.01%) ⬆️
spark-client-hadoop-common 48.55% <ø> (-0.01%) ⬇️
spark-java-tests 49.40% <ø> (-0.03%) ⬇️
spark-scala-tests 45.32% <ø> (+0.01%) ⬆️
utilities 38.02% <ø> (+0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.
see 10 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@hudi-bot
Copy link
Copy Markdown
Collaborator

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

Copy link
Copy Markdown
Contributor

@hudi-agent hudi-agent left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🤖 This review was generated by an AI agent and may contain mistakes. Please verify any suggestions before applying.

Thanks for the contribution! This PR bumps spark4.version and spark40.version from 4.0.1 to 4.0.2 to pick up the latest upstream patch release. No issues flagged from this automated pass — a Hudi committer or PMC member can take it from here for a final review.

cc @yihua

Copy link
Copy Markdown
Contributor

@yihua yihua left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@yihua yihua merged commit ddbdbb9 into apache:master Apr 23, 2026
56 checks passed
@voonhous voonhous deleted the bump-to-spark4.0.2 branch April 23, 2026 07:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:XS PR with lines of changes in <= 10

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants