Skip to content

fix: hdfs - build without yarn/mapreduce#667

Merged
adwk67 merged 5 commits intomainfrom
chore/hdfs-remove-subprojects
May 14, 2024
Merged

fix: hdfs - build without yarn/mapreduce#667
adwk67 merged 5 commits intomainfrom
chore/hdfs-remove-subprojects

Conversation

@adwk67
Copy link
Copy Markdown
Member

@adwk67 adwk67 commented May 13, 2024

Description

Builds hadoop without the yarn or mapreduce projects to remove e.g. HTrace and dependencies.
Tested locally with nightly test-suite and the HBase/HDFS demo.

--- PASS: kuttl (3845.16s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/kerberos_hadoop-latest-3.3.4_zookeeper-latest-3.9.1_kerberos-realm-CLUSTER.LOCAL_kerberos-backend-mit_openshift-false (1271.96s)
        --- PASS: kuttl/harness/smoke_hadoop-3.3.6_zookeeper-3.8.3_zookeeper-latest-3.9.1_number-of-datanodes-2_datanode-pvcs-2hdd-1ssd_listener-class-external-unstable_openshift-false (154.46s)
        --- PASS: kuttl/harness/topology-provider_hadoop-latest-3.3.4_zookeeper-latest-3.9.1_kerberos-backend-mit_openshift-false (234.84s)
        --- PASS: kuttl/harness/orphaned-resources_hadoop-latest-3.3.4_zookeeper-latest-3.9.1_openshift-false (139.92s)
        --- PASS: kuttl/harness/cluster-operation_hadoop-latest-3.3.4_zookeeper-latest-3.9.1_openshift-false (197.40s)
        --- PASS: kuttl/harness/smoke_hadoop-3.3.6_zookeeper-3.8.3_zookeeper-latest-3.9.1_number-of-datanodes-2_datanode-pvcs-2hdd-1ssd_listener-class-cluster-internal_openshift-false (155.98s)
        --- PASS: kuttl/harness/profiling_hadoop-3.3.6_zookeeper-latest-3.9.1_openshift-false (111.76s)
        --- PASS: kuttl/harness/logging_hadoop-3.3.6_zookeeper-latest-3.9.1_openshift-false (452.73s)
        --- PASS: kuttl/harness/kerberos_hadoop-latest-3.3.4_zookeeper-latest-3.9.1_kerberos-realm-PROD.MYCORP_kerberos-backend-mit_openshift-false (1125.54s)

Definition of Done Checklist

  • Not all of these items are applicable to all PRs, the author should update this template to only leave the boxes in that are relevant
  • Please make sure all these things are done and tick the boxes
- [x] Changes are OpenShift compatible
- [x] All added packages (via microdnf or otherwise) have a comment on why they are added (or removed)
- [x] Add an entry to the CHANGELOG.md file
- [x] Integration tests ran successfully
TIP: Running integration tests with a new product image

The image can be built and uploaded to the kind cluster with the following commands:

bake --product <product> --image-version <stackable-image-version>
kind load docker-image <image-tagged-with-the-major-version> --name=<name-of-your-test-cluster>

See the output of bake to retrieve the image tag for <image-tagged-with-the-major-version>.

@adwk67 adwk67 marked this pull request as ready for review May 13, 2024 15:47
Maleware
Maleware previously approved these changes May 14, 2024
Copy link
Copy Markdown
Member

@Maleware Maleware left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, Build on ARM64 and looks great. Thank you!

@adwk67 adwk67 added this pull request to the merge queue May 14, 2024
Merged via the queue into main with commit efe10db May 14, 2024
@adwk67 adwk67 deleted the chore/hdfs-remove-subprojects branch May 14, 2024 09:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants