Skip to content

Update Spark 3.5 from 3.5.5 to 3.5.6 #19124

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
May 29, 2025

Conversation

HyukjinKwon
Copy link
Contributor

This PR proposes to update Spark 3.5 to its latest 3.5.6.

@HyukjinKwon HyukjinKwon requested a review from a team as a code owner May 29, 2025 06:18
Copy link

Diff for 49be991:
diff --git a/_bashbrew-cat b/_bashbrew-cat
index 1aa7ea0..a8391a3 100644
--- a/_bashbrew-cat
+++ b/_bashbrew-cat
@@ -1,45 +1,45 @@
 Maintainers: Apache Spark Developers <dev@spark.apache.org> (@ApacheSpark)
 GitRepo: https://github.com/apache/spark-docker.git
 
-Tags: 3.5.5-scala2.12-java11-python3-r-ubuntu
+Tags: 3.5.6-scala2.12-java11-python3-r-ubuntu
 Architectures: amd64, arm64v8
-GitCommit: 86f243f6df77cf247f8eb9931558d719e0c56144
-Directory: 3.5.5/scala2.12-java11-python3-r-ubuntu
+GitCommit: c264d48dc510018095700ed33e700ccc34268bf2
+Directory: 3.5.6/scala2.12-java11-python3-r-ubuntu
 
-Tags: 3.5.5-scala2.12-java11-python3-ubuntu, 3.5.5-python3, 3.5.5
+Tags: 3.5.6-scala2.12-java11-python3-ubuntu, 3.5.6-python3, 3.5.6
 Architectures: amd64, arm64v8
-GitCommit: 86f243f6df77cf247f8eb9931558d719e0c56144
-Directory: 3.5.5/scala2.12-java11-python3-ubuntu
+GitCommit: c264d48dc510018095700ed33e700ccc34268bf2
+Directory: 3.5.6/scala2.12-java11-python3-ubuntu
 
-Tags: 3.5.5-scala2.12-java11-r-ubuntu, 3.5.5-r
+Tags: 3.5.6-scala2.12-java11-r-ubuntu, 3.5.6-r
 Architectures: amd64, arm64v8
-GitCommit: 86f243f6df77cf247f8eb9931558d719e0c56144
-Directory: 3.5.5/scala2.12-java11-r-ubuntu
+GitCommit: c264d48dc510018095700ed33e700ccc34268bf2
+Directory: 3.5.6/scala2.12-java11-r-ubuntu
 
-Tags: 3.5.5-scala2.12-java11-ubuntu, 3.5.5-scala
+Tags: 3.5.6-scala2.12-java11-ubuntu, 3.5.6-scala
 Architectures: amd64, arm64v8
-GitCommit: 86f243f6df77cf247f8eb9931558d719e0c56144
-Directory: 3.5.5/scala2.12-java11-ubuntu
+GitCommit: c264d48dc510018095700ed33e700ccc34268bf2
+Directory: 3.5.6/scala2.12-java11-ubuntu
 
-Tags: 3.5.5-scala2.12-java17-python3-r-ubuntu
+Tags: 3.5.6-scala2.12-java17-python3-r-ubuntu
 Architectures: amd64, arm64v8
-GitCommit: 86f243f6df77cf247f8eb9931558d719e0c56144
-Directory: 3.5.5/scala2.12-java17-python3-r-ubuntu
+GitCommit: c264d48dc510018095700ed33e700ccc34268bf2
+Directory: 3.5.6/scala2.12-java17-python3-r-ubuntu
 
-Tags: 3.5.5-scala2.12-java17-python3-ubuntu, 3.5.5-java17-python3, 3.5.5-java17
+Tags: 3.5.6-scala2.12-java17-python3-ubuntu, 3.5.6-java17-python3, 3.5.6-java17
 Architectures: amd64, arm64v8
-GitCommit: 86f243f6df77cf247f8eb9931558d719e0c56144
-Directory: 3.5.5/scala2.12-java17-python3-ubuntu
+GitCommit: c264d48dc510018095700ed33e700ccc34268bf2
+Directory: 3.5.6/scala2.12-java17-python3-ubuntu
 
-Tags: 3.5.5-scala2.12-java17-r-ubuntu, 3.5.5-java17-r
+Tags: 3.5.6-scala2.12-java17-r-ubuntu, 3.5.6-java17-r
 Architectures: amd64, arm64v8
-GitCommit: 86f243f6df77cf247f8eb9931558d719e0c56144
-Directory: 3.5.5/scala2.12-java17-r-ubuntu
+GitCommit: c264d48dc510018095700ed33e700ccc34268bf2
+Directory: 3.5.6/scala2.12-java17-r-ubuntu
 
-Tags: 3.5.5-scala2.12-java17-ubuntu, 3.5.5-java17-scala
+Tags: 3.5.6-scala2.12-java17-ubuntu, 3.5.6-java17-scala
 Architectures: amd64, arm64v8
-GitCommit: 86f243f6df77cf247f8eb9931558d719e0c56144
-Directory: 3.5.5/scala2.12-java17-ubuntu
+GitCommit: c264d48dc510018095700ed33e700ccc34268bf2
+Directory: 3.5.6/scala2.12-java17-ubuntu
 
 Tags: 4.0.0-scala2.13-java17-python3-r-ubuntu
 Architectures: amd64, arm64v8
diff --git a/_bashbrew-list b/_bashbrew-list
index 2e85a15..ac36708 100644
--- a/_bashbrew-list
+++ b/_bashbrew-list
@@ -1,19 +1,19 @@
-spark:3.5.5
-spark:3.5.5-java17
-spark:3.5.5-java17-python3
-spark:3.5.5-java17-r
-spark:3.5.5-java17-scala
-spark:3.5.5-python3
-spark:3.5.5-r
-spark:3.5.5-scala
-spark:3.5.5-scala2.12-java11-python3-r-ubuntu
-spark:3.5.5-scala2.12-java11-python3-ubuntu
-spark:3.5.5-scala2.12-java11-r-ubuntu
-spark:3.5.5-scala2.12-java11-ubuntu
-spark:3.5.5-scala2.12-java17-python3-r-ubuntu
-spark:3.5.5-scala2.12-java17-python3-ubuntu
-spark:3.5.5-scala2.12-java17-r-ubuntu
-spark:3.5.5-scala2.12-java17-ubuntu
+spark:3.5.6
+spark:3.5.6-java17
+spark:3.5.6-java17-python3
+spark:3.5.6-java17-r
+spark:3.5.6-java17-scala
+spark:3.5.6-python3
+spark:3.5.6-r
+spark:3.5.6-scala
+spark:3.5.6-scala2.12-java11-python3-r-ubuntu
+spark:3.5.6-scala2.12-java11-python3-ubuntu
+spark:3.5.6-scala2.12-java11-r-ubuntu
+spark:3.5.6-scala2.12-java11-ubuntu
+spark:3.5.6-scala2.12-java17-python3-r-ubuntu
+spark:3.5.6-scala2.12-java17-python3-ubuntu
+spark:3.5.6-scala2.12-java17-r-ubuntu
+spark:3.5.6-scala2.12-java17-ubuntu
 spark:4.0.0
 spark:4.0.0-java21
 spark:4.0.0-java21-python3
diff --git a/_bashbrew-list-build-order b/_bashbrew-list-build-order
index 7ec4e03..99d369b 100644
--- a/_bashbrew-list-build-order
+++ b/_bashbrew-list-build-order
@@ -1,15 +1,15 @@
-spark:3.5.5-java17-scala
-spark:3.5.5-scala
-spark:3.5.5-scala2.12-java11-python3-r-ubuntu
-spark:3.5.5-scala2.12-java17-python3-r-ubuntu
+spark:3.5.6-java17-scala
+spark:3.5.6-scala
+spark:3.5.6-scala2.12-java11-python3-r-ubuntu
+spark:3.5.6-scala2.12-java17-python3-r-ubuntu
 spark:4.0.0-java21-scala
 spark:4.0.0-scala2.13-java21-python3-r-ubuntu
 spark:latest
 spark:scala
-spark:3.5.5
-spark:3.5.5-java17
-spark:3.5.5-java17-r
-spark:3.5.5-r
+spark:3.5.6
+spark:3.5.6-java17
+spark:3.5.6-java17-r
+spark:3.5.6-r
 spark:4.0.0-java21-r
 spark:4.0.0-scala2.13-java17-python3-r-ubuntu
 spark:python3-java17
diff --git a/spark_3.5.5-java17-r/Dockerfile b/spark_3.5.6-java17-r/Dockerfile
similarity index 95%
rename from spark_3.5.5-java17-r/Dockerfile
rename to spark_3.5.6-java17-r/Dockerfile
index 1fdf9b9..204f72b 100644
--- a/spark_3.5.5-java17-r/Dockerfile
+++ b/spark_3.5.6-java17-r/Dockerfile
@@ -14,7 +14,7 @@
 # See the License for the specific language governing permissions and
 # limitations under the License.
 #
-FROM spark:3.5.5-scala2.12-java17-ubuntu
+FROM spark:3.5.6-scala2.12-java17-ubuntu
 
 USER root
 
diff --git a/spark_3.5.5-java17-scala/Dockerfile b/spark_3.5.6-java17-scala/Dockerfile
similarity index 95%
rename from spark_3.5.5-java17-scala/Dockerfile
rename to spark_3.5.6-java17-scala/Dockerfile
index fc83654..2f55374 100644
--- a/spark_3.5.5-java17-scala/Dockerfile
+++ b/spark_3.5.6-java17-scala/Dockerfile
@@ -36,9 +36,9 @@ RUN set -ex; \
 
 # Install Apache Spark
 # https://downloads.apache.org/spark/KEYS
-ENV SPARK_TGZ_URL=https://archive.apache.org/dist/spark/spark-3.5.5/spark-3.5.5-bin-hadoop3.tgz \
-    SPARK_TGZ_ASC_URL=https://archive.apache.org/dist/spark/spark-3.5.5/spark-3.5.5-bin-hadoop3.tgz.asc \
-    GPG_KEY=F28C9C925C188C35E345614DEDA00CE834F0FC5C
+ENV SPARK_TGZ_URL=https://archive.apache.org/dist/spark/spark-3.5.6/spark-3.5.6-bin-hadoop3.tgz \
+    SPARK_TGZ_ASC_URL=https://archive.apache.org/dist/spark/spark-3.5.6/spark-3.5.6-bin-hadoop3.tgz.asc \
+    GPG_KEY=0FE4571297AB84440673665669600C8338F65970
 
 RUN set -ex; \
     export SPARK_TMP="$(mktemp -d)"; \
diff --git a/spark_3.5.5-java17-scala/entrypoint.sh b/spark_3.5.6-java17-scala/entrypoint.sh
similarity index 100%
rename from spark_3.5.5-java17-scala/entrypoint.sh
rename to spark_3.5.6-java17-scala/entrypoint.sh
diff --git a/spark_3.5.5-java17/Dockerfile b/spark_3.5.6-java17/Dockerfile
similarity index 95%
rename from spark_3.5.5-java17/Dockerfile
rename to spark_3.5.6-java17/Dockerfile
index d9fb2f4..e175f84 100644
--- a/spark_3.5.5-java17/Dockerfile
+++ b/spark_3.5.6-java17/Dockerfile
@@ -14,7 +14,7 @@
 # See the License for the specific language governing permissions and
 # limitations under the License.
 #
-FROM spark:3.5.5-scala2.12-java17-ubuntu
+FROM spark:3.5.6-scala2.12-java17-ubuntu
 
 USER root
 
diff --git a/spark_3.5.5-r/Dockerfile b/spark_3.5.6-r/Dockerfile
similarity index 95%
rename from spark_3.5.5-r/Dockerfile
rename to spark_3.5.6-r/Dockerfile
index 7beaf3f..7f8a4dd 100644
--- a/spark_3.5.5-r/Dockerfile
+++ b/spark_3.5.6-r/Dockerfile
@@ -14,7 +14,7 @@
 # See the License for the specific language governing permissions and
 # limitations under the License.
 #
-FROM spark:3.5.5-scala2.12-java11-ubuntu
+FROM spark:3.5.6-scala2.12-java11-ubuntu
 
 USER root
 
diff --git a/spark_3.5.5-scala/Dockerfile b/spark_3.5.6-scala/Dockerfile
similarity index 95%
rename from spark_3.5.5-scala/Dockerfile
rename to spark_3.5.6-scala/Dockerfile
index 2adc6a6..d309bf8 100644
--- a/spark_3.5.5-scala/Dockerfile
+++ b/spark_3.5.6-scala/Dockerfile
@@ -36,9 +36,9 @@ RUN set -ex; \
 
 # Install Apache Spark
 # https://downloads.apache.org/spark/KEYS
-ENV SPARK_TGZ_URL=https://archive.apache.org/dist/spark/spark-3.5.5/spark-3.5.5-bin-hadoop3.tgz \
-    SPARK_TGZ_ASC_URL=https://archive.apache.org/dist/spark/spark-3.5.5/spark-3.5.5-bin-hadoop3.tgz.asc \
-    GPG_KEY=F28C9C925C188C35E345614DEDA00CE834F0FC5C
+ENV SPARK_TGZ_URL=https://archive.apache.org/dist/spark/spark-3.5.6/spark-3.5.6-bin-hadoop3.tgz \
+    SPARK_TGZ_ASC_URL=https://archive.apache.org/dist/spark/spark-3.5.6/spark-3.5.6-bin-hadoop3.tgz.asc \
+    GPG_KEY=0FE4571297AB84440673665669600C8338F65970
 
 RUN set -ex; \
     export SPARK_TMP="$(mktemp -d)"; \
diff --git a/spark_3.5.5-scala/entrypoint.sh b/spark_3.5.6-scala/entrypoint.sh
similarity index 100%
rename from spark_3.5.5-scala/entrypoint.sh
rename to spark_3.5.6-scala/entrypoint.sh
diff --git a/spark_3.5.5-scala2.12-java17-python3-r-ubuntu/Dockerfile b/spark_3.5.6-scala2.12-java11-python3-r-ubuntu/Dockerfile
similarity index 96%
rename from spark_3.5.5-scala2.12-java17-python3-r-ubuntu/Dockerfile
rename to spark_3.5.6-scala2.12-java11-python3-r-ubuntu/Dockerfile
index a900883..a6bf459 100644
--- a/spark_3.5.5-scala2.12-java17-python3-r-ubuntu/Dockerfile
+++ b/spark_3.5.6-scala2.12-java11-python3-r-ubuntu/Dockerfile
@@ -14,7 +14,7 @@
 # See the License for the specific language governing permissions and
 # limitations under the License.
 #
-FROM spark:3.5.5-scala2.12-java17-ubuntu
+FROM spark:3.5.6-scala2.12-java11-ubuntu
 
 USER root
 
diff --git a/spark_3.5.5-scala2.12-java11-python3-r-ubuntu/Dockerfile b/spark_3.5.6-scala2.12-java17-python3-r-ubuntu/Dockerfile
similarity index 96%
rename from spark_3.5.5-scala2.12-java11-python3-r-ubuntu/Dockerfile
rename to spark_3.5.6-scala2.12-java17-python3-r-ubuntu/Dockerfile
index b5127ed..9f39101 100644
--- a/spark_3.5.5-scala2.12-java11-python3-r-ubuntu/Dockerfile
+++ b/spark_3.5.6-scala2.12-java17-python3-r-ubuntu/Dockerfile
@@ -14,7 +14,7 @@
 # See the License for the specific language governing permissions and
 # limitations under the License.
 #
-FROM spark:3.5.5-scala2.12-java11-ubuntu
+FROM spark:3.5.6-scala2.12-java17-ubuntu
 
 USER root
 
diff --git a/spark_3.5.5/Dockerfile b/spark_3.5.6/Dockerfile
similarity index 95%
rename from spark_3.5.5/Dockerfile
rename to spark_3.5.6/Dockerfile
index 5c3033d..5d63326 100644
--- a/spark_3.5.5/Dockerfile
+++ b/spark_3.5.6/Dockerfile
@@ -14,7 +14,7 @@
 # See the License for the specific language governing permissions and
 # limitations under the License.
 #
-FROM spark:3.5.5-scala2.12-java11-ubuntu
+FROM spark:3.5.6-scala2.12-java11-ubuntu
 
 USER root

Relevant Maintainers:

@tianon tianon merged commit dd66946 into docker-library:master May 29, 2025
14 of 15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants