HADOOP-19814: Create hadoop-runner:jdk17-u2404 with Ubuntu 24.04.

[cnauroth]

Description of PR

This creates a new base Hadoop runner image with JDK 17 and Ubuntu 24.04 to align with the release image for Hadoop 3.5.0. I have pushed a new branch: docker-hadoop-runner-jdk17-u2404, based on the latest state of docker-hadoop-runner-jdk17-u2204. The diff shown in this pull request is the incremental changes required:

• Switch to Ubuntu 24.04 for the base image.
• Switch from pip to pipx for robotframework installation, because the host Python deployment is now managed by the OS and rejects pip installations.
• Upgrade to latest version of async profiler.
• Change hadoop uid/gid from 1000 to 1001, because 1000 is now occupied by a "ubuntu" user.

How was this patch tested?

I built a Hadoop 3.5.0 image (separate PR) using this image as the base and used the Docker Compose harness to test NameNode, DataNode, ResourceManager and NodeManager.

For code changes:

• Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
• Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
• If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
• If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

AI Tooling

If an AI tool was used:

• The PR includes the phrase "Contains content generated by "
  where is the name of the AI tool used.
• My use of AI contributions follows the ASF legal policy
  https://www.apache.org/legal/generative-tooling.html

[cnauroth]

@pan3793 FYI

[ayushtkn]

LGTM

[cnauroth]

Thanks for the reviews, @ayushtkn , @pan3793 and @slfan1989 . I committed these changes to the new docker-hadoop-runner-jdk17-u2404 branch.

@ayushtkn , the HowToRelease wiki mentions working with you to get new images published. Do you know what we need to do next? I noticed this GitHub action failed:

https://github.com/apache/hadoop/actions/runs/24204001269

[ayushtkn]

@cnauroth your tag got pushed:
https://hub.docker.com/layers/apache/hadoop-runner/jdk17-u2404/images/sha256-60a16f19c70cc6b2cb5bd51d180c62f2ae7282cdfc90740a1c1539ce21db6ae7

The 3.5.0 is also there:
https://hub.docker.com/repository/docker/apache/hadoop/tags/3.5.0/sha256:28b60103770cf4db0f7e745df6492734ea9bb18198d11ca35196eb097c851d65

It gets auto build by DockerHub as soon as we create a branch matching the pattern

[ayushtkn]

And I think to the wrong repo as well:
https://hub.docker.com/layers/apache/hadoop/runner-jdk17-u2404/images/sha256-fc3a57877064a43f69ef79d6cb79206bf2bbe9b04bb8436b5307b8282a0e3e71

I have access to apache/hadoop dockerhub not the other ones