Skip to content

Conversation

@cloud-fan
Copy link
Contributor

What changes were proposed in this pull request?

This updates the release manager Docker image to include both Java 8 and Java 17, enabling builds for all active Spark branches:

  • Spark < 4.0: requires Java 8
  • Spark >= 4.0: requires Java 17

Changes:

  • Add openjdk-8-jdk-headless alongside existing Java 17
  • Set up architecture-aware Java paths in /etc/profile.d/java.sh (works on both amd64 and arm64)
  • Export JAVA8_HOME, JAVA17_HOME, and JAVA_HOME environment variables

Why are the changes needed?

To support releasing all active Spark versions (3.5, 4.0, 4.1, 4.2) from a single Docker image. The release scripts will automatically select the appropriate Java version based on the Spark version being released.

Does this PR introduce any user-facing change?

No. This only affects the release infrastructure.

How was this patch tested?

Manual testing by building the Docker image and verifying both Java versions are installed.

Was this patch authored or co-authored using generative AI tooling?

Yes. cursor 2.3.41

This updates the release manager Docker image to include both Java 8 and Java 17, enabling builds for all active Spark branches:
- Spark < 4.0: requires Java 8
- Spark >= 4.0: requires Java 17

The release scripts will automatically select the appropriate Java version based on the Spark version being released.

Changes:
- Add openjdk-8-jdk-headless alongside existing Java 17
- Set up architecture-aware Java paths in /etc/profile.d/java.sh
- Export JAVA8_HOME, JAVA17_HOME, and JAVA_HOME environment variables
@github-actions
Copy link

JIRA Issue Information

=== Improvement SPARK-55115 ===
Summary: Use master branch's Dockerfile for release builds
Assignee: None
Status: Open
Affected: ["4.2.0"]


This comment was automatically generated by GitHub Actions

@cloud-fan cloud-fan marked this pull request as draft January 21, 2026 18:35
@cloud-fan
Copy link
Contributor Author

This only fixes java version but not python version, switching to #53905

@cloud-fan cloud-fan closed this Jan 22, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants