Skip to content

fix: add jaxb library no longer bundled with hadoop#688

Merged
adwk67 merged 2 commits intomainfrom
fix/hive-jaxb
May 21, 2024
Merged

fix: add jaxb library no longer bundled with hadoop#688
adwk67 merged 2 commits intomainfrom
fix/hive-jaxb

Conversation

@adwk67
Copy link
Copy Markdown
Member

@adwk67 adwk67 commented May 17, 2024

Description

fixes stackabletech/hive-operator#468.

Recent changes to the hadoop image resulted in a missing logging dependency (jackson-module-jaxb-annotations was originally bundler with the hadoop yarn client): this PR adds the missing specific version.
Start-up scripts for hadoop functions check various env-vars, even if the associated modules are never run. To avoid errors with the initialisation of these scripts default values have been set where necessary.

Local testing with repo: docker.stackable.tech/sandbox/yarnless-hive :-

--- PASS: kuttl (1193.36s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/kerberos-s3_postgres-12.5.6_hive-3.1.3_openshift-false_s3-use-tls-true_kerberos-realm-PROD.MYCORP_kerberos-backend-mit (315.83s)
        --- PASS: kuttl/harness/logging_postgres-12.5.6_hive-3.1.3_openshift-false (167.48s)
        --- PASS: kuttl/harness/orphaned-resources_hive-latest-3.1.3_openshift-false (124.31s)
        --- PASS: kuttl/harness/cluster-operation_hive-latest-3.1.3_openshift-false (75.79s)
        --- PASS: kuttl/harness/resources_hive-3.1.3_openshift-false (41.52s)
        --- PASS: kuttl/harness/smoke_postgres-12.5.6_hive-3.1.3_openshift-false_s3-use-tls-true (95.33s)
        --- PASS: kuttl/harness/kerberos-hdfs_postgres-12.5.6_hive-3.1.3_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_openshift-false_kerberos-realm-PROD.MYCORP_kerberos-backend-mit (372.61s)

Definition of Done Checklist

  • Not all of these items are applicable to all PRs, the author should update this template to only leave the boxes in that are relevant
  • Please make sure all these things are done and tick the boxes
- [ ] Changes are OpenShift compatible
- [x] All added packages (via microdnf or otherwise) have a comment on why they are added
- [x] Things not downloaded from Red Hat repositories should be mirrored in the Stackable repository and downloaded from there
- [ ] All packages should have (if available) signatures/hashes verified
- [x] Add an entry to the CHANGELOG.md file
- [x] Integration tests ran successfully
TIP: Running integration tests with a new product image

The image can be built and uploaded to the kind cluster with the following commands:

bake --product <product> --image-version <stackable-image-version>
kind load docker-image <image-tagged-with-the-major-version> --name=<name-of-your-test-cluster>

See the output of bake to retrieve the image tag for <image-tagged-with-the-major-version>.

@adwk67 adwk67 self-assigned this May 17, 2024
Copy link
Copy Markdown
Member

@sbernauer sbernauer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for figuring this out!

@adwk67 adwk67 added this pull request to the merge queue May 21, 2024
Merged via the queue into main with commit 801c6a9 May 21, 2024
@adwk67 adwk67 deleted the fix/hive-jaxb branch May 21, 2024 07:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

fix: yarn home copied from hdfs builder

2 participants