Skip to content

Conversation

razvan
Copy link
Member

@razvan razvan commented Sep 26, 2025

Description

Part of stackabletech/docker-images#1273

Depends on stackabletech/docker-images#1280

Definition of Done Checklist

  • Not all of these items are applicable to all PRs, the author should update this template to only leave the boxes in that are relevant
  • Please make sure all these things are done and tick the boxes

Author

  • Changes are OpenShift compatible
  • CRD changes approved
  • CRD documentation for all fields, following the style guide.
  • Helm chart can be installed and deployed operator works
  • Integration tests passed (for non trivial changes)
  • Changes need to be "offline" compatible
  • Links to generated (nightly) docs added
  • Release note snippet added

Reviewer

  • Code contains useful comments
  • Code contains useful logging statements
  • (Integration-)Test cases added
  • Documentation added or updated. Follows the style guide.
  • Changelog updated
  • Cargo.toml only contains references to git tags (not specific commits or branches)

Acceptance

  • Feature Tracker has been updated
  • Proper release label has been added
  • Links to generated (nightly) docs added
  • Release note snippet added
  • Add type/deprecation label & add to the deprecation schedule
  • Add type/experimental label & add to the experimental features tracker

@razvan razvan requested a review from a team September 26, 2025 15:32
@razvan
Copy link
Member Author

razvan commented Sep 26, 2025

will look into the failing tests again

--- FAIL: kuttl (2517.29s)
    --- FAIL: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/overrides_openshift-false_spark-3.5.7 (152.72s)
        --- FAIL: kuttl/harness/delta-lake_openshift-false_spark-delta-lake-3.5.7_delta-3.1.0 (371.21s)
        --- PASS: kuttl/harness/spark-pi-private-s3_openshift-false_spark-3.5.7 (114.55s)
        --- PASS: kuttl/harness/pyspark-ny-public-s3_openshift-false_spark-3.5.7 (160.52s)
        --- PASS: kuttl/harness/logging_openshift-false_spark-logging-3.5.7_ny-tlc-report-0.3.0 (312.24s)
        --- FAIL: kuttl/harness/hbase-connector_openshift-false_spark-hbase-connector-3.5.7_hbase-2.6.1_hdfs-latest-3.4.1_zookeeper-latest-3.9.3 (1117.64s)
        --- PASS: kuttl/harness/spark-connect_openshift-false_spark-connect-3.5.7 (117.92s)
        --- PASS: kuttl/harness/pyspark-ny-public-s3-image_openshift-false_spark-3.5.7_ny-tlc-report-0.3.0 (126.54s)
        --- PASS: kuttl/harness/spark-ny-public-s3_openshift-false_spark-3.5.7_s3-use-tls-false (129.67s)
        --- PASS: kuttl/harness/smoke_openshift-false_spark-3.5.7_s3-use-tls-true (164.30s)
        --- PASS: kuttl/harness/smoke_openshift-false_spark-3.5.7_s3-use-tls-false (156.16s)
        --- FAIL: kuttl/harness/hbase-connector_openshift-false_spark-hbase-connector-3.5.7_hbase-2.6.2_hdfs-latest-3.4.1_zookeeper-latest-3.9.3 (1107.34s)
        --- PASS: kuttl/harness/spark-ny-public-s3_openshift-false_spark-3.5.7_s3-use-tls-true (136.68s)
        --- PASS: kuttl/harness/custom-log-directory_openshift-false_spark-3.5.7_hdfs-latest-3.4.1_zookeeper-latest-3.9.3 (184.86s)
        --- PASS: kuttl/harness/iceberg_openshift-false_spark-iceberg-3.5.7 (56.93s)
        --- PASS: kuttl/harness/spark-history-server_openshift-false_spark-3.5.7_s3-use-tls-true (212.26s)
        --- PASS: kuttl/harness/resources_openshift-false_spark-3.5.7 (92.72s)
        --- PASS: kuttl/harness/spark-examples_openshift-false_spark-3.5.7 (44.00s)
        --- PASS: kuttl/harness/spark-history-server_openshift-false_spark-3.5.7_s3-use-tls-false (209.17s)
FAIL
ERROR:root:kuttl failed

@razvan
Copy link
Member Author

razvan commented Sep 29, 2025

Tests are now green

--- PASS: kuttl (202.08s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/delta-lake_openshift-false_spark-delta-lake-3.5.7_delta-3.1.0 (160.34s)
        --- PASS: kuttl/harness/hbase-connector_openshift-false_spark-hbase-connector-3.5.7_hbase-2.6.1_hdfs-latest-3.4.1_zookeeper-latest-3.9.3 (200.53s)
        --- PASS: kuttl/harness/hbase-connector_openshift-false_spark-hbase-connector-3.5.7_hbase-2.6.2_hdfs-latest-3.4.1_zookeeper-latest-3.9.3 (201.62s)
PASS

@razvan razvan changed the title chore: update versions for 25.11.0 release chore(spark): update versions for 25.11.0 release Sep 29, 2025
@razvan razvan changed the title chore(spark): update versions for 25.11.0 release chore(spark-operator): update versions for 25.11.0 release Sep 29, 2025
@razvan razvan moved this to Development: Waiting for Review in Stackable Engineering Sep 29, 2025
@sbernauer sbernauer moved this from Development: Waiting for Review to Development: In Review in Stackable Engineering Sep 29, 2025
@razvan
Copy link
Member Author

razvan commented Sep 29, 2025

🟢 4.0.1 tests

--- PASS: kuttl (2945.10s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/overrides_openshift-false_spark-4.0.1 (141.42s)
        --- PASS: kuttl/harness/spark-connect_openshift-false_spark-connect-4.0.1 (130.67s)
        --- PASS: kuttl/harness/spark-ny-public-s3_openshift-false_spark-4.0.1_s3-use-tls-false (140.12s)
        --- PASS: kuttl/harness/smoke_openshift-false_spark-4.0.1_s3-use-tls-true (175.54s)
        --- PASS: kuttl/harness/smoke_openshift-false_spark-4.0.1_s3-use-tls-false (167.22s)
        --- PASS: kuttl/harness/iceberg_openshift-false_spark-iceberg-3.5.7 (59.93s)
        --- PASS: kuttl/harness/pyspark-ny-public-s3-image_openshift-false_spark-4.0.1_ny-tlc-report-0.3.0 (143.00s)
        --- PASS: kuttl/harness/spark-ny-public-s3_openshift-false_spark-4.0.1_s3-use-tls-true (147.96s)
        --- PASS: kuttl/harness/pyspark-ny-public-s3_openshift-false_spark-4.0.1 (140.32s)
        --- PASS: kuttl/harness/spark-pi-private-s3_openshift-false_spark-4.0.1 (120.47s)
        --- PASS: kuttl/harness/logging_openshift-false_spark-logging-3.5.7_ny-tlc-report-0.3.0 (307.83s)
        --- PASS: kuttl/harness/delta-lake_openshift-false_spark-delta-lake-3.5.7_delta-3.1.0 (311.57s)
        --- PASS: kuttl/harness/spark-history-server_openshift-false_spark-4.0.1_s3-use-tls-true (230.21s)
        --- PASS: kuttl/harness/custom-log-directory_openshift-false_spark-4.0.1_hdfs-latest-3.4.1_zookeeper-latest-3.9.3 (187.64s)
        --- PASS: kuttl/harness/spark-history-server_openshift-false_spark-4.0.1_s3-use-tls-false (213.86s)
        --- PASS: kuttl/harness/resources_openshift-false_spark-4.0.1 (97.49s)
        --- PASS: kuttl/harness/spark-examples_openshift-false_spark-4.0.1 (48.91s)
        --- PASS: kuttl/harness/hbase-connector_openshift-false_spark-hbase-connector-3.5.7_hbase-2.6.2_hdfs-latest-3.4.1_zookeeper-latest-3.9.3 (180.48s)
PASS

sbernauer
sbernauer previously approved these changes Sep 30, 2025
Copy link
Member

@sbernauer sbernauer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM otherwise.

@razvan razvan added this pull request to the merge queue Sep 30, 2025
Merged via the queue into main with commit 3394071 Sep 30, 2025
29 of 32 checks passed
@razvan razvan deleted the docker-images/issues/1273 branch September 30, 2025 09:36
@sbernauer sbernauer moved this from Development: In Review to Development: Done in Stackable Engineering Sep 30, 2025
@lfrancke lfrancke moved this from Development: Done to Done in Stackable Engineering Oct 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Development

Successfully merging this pull request may close these issues.

2 participants