HADOOP-19814: Create Hadoop 3.5.0 Docker image#8414
Conversation
|
#8413 is a prerequisite for this. |
|
@pan3793 FYI |
Closes #8414 Signed-off-by: Shilun Fan <slfan1989@apache.org> Signed-off-by: Ayush Saxena <ayushsaxena@apache.org> Reviewed-by: Cheng Pan <chengpan@apache.org>
|
I merged this to docker-hadoop-3.5.0. Thank you for the reviews, @ayushtkn , @slfan1989 , @pan3793 . |
|
Hello @ayushtkn . Sorry to bother again, but I am not seeing a new build of the 3.5.0 tag after merging this PR. Is there anything else I need to do? |
|
Hi @cnauroth |
|
@cnauroth |
|
@ayushtkn , OK, I see now there is supposed to be a GitHub action pushing the base runner image to GHCR: I don't see the base image in GHCR: https://github.com/apache/hadoop/pkgs/container/hadoop-runner It looks like the GitHub action failed: https://github.com/apache/hadoop/actions/runs/24204001269 I'm thinking that we need to make sure our build-hadoop-runner-image.yaml has the same commit hash for every action aligned with what is being allowed by ASF infra: https://github.com/apache/infrastructure-actions/blob/main/actions.yml I'll try a PR for this later. |

Description of PR
Create a Hadoop 3.5.0 Docker image. I pushed a new branch, docker-hadoop-3.5.0, based on current docker-hadoop-3.4.3. This pull request shows the incremental changes required:
fs.default.namefrom test core-site.xml to avoid log spam about deprecation of this property in 3.5.0.versionfrom docker-compose.yaml to avoid deprecation warning.This won't actually build successfully until we publish the new hadoop-runner:jdk17-u2404 base image, though you can build locally.
How was this patch tested?
I used the Docker Compose harness to test NameNode, DataNode, ResourceManager and NodeManager.
For code changes:
LICENSE,LICENSE-binary,NOTICE-binaryfiles?AI Tooling
If an AI tool was used:
where is the name of the AI tool used.
https://www.apache.org/legal/generative-tooling.html