-
Notifications
You must be signed in to change notification settings - Fork 2.4k
Update Spark 3.5 from 3.5.5 to 3.5.6 #19124
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Diff for 49be991:diff --git a/_bashbrew-cat b/_bashbrew-cat
index 1aa7ea0..a8391a3 100644
--- a/_bashbrew-cat
+++ b/_bashbrew-cat
@@ -1,45 +1,45 @@
Maintainers: Apache Spark Developers <dev@spark.apache.org> (@ApacheSpark)
GitRepo: https://github.com/apache/spark-docker.git
-Tags: 3.5.5-scala2.12-java11-python3-r-ubuntu
+Tags: 3.5.6-scala2.12-java11-python3-r-ubuntu
Architectures: amd64, arm64v8
-GitCommit: 86f243f6df77cf247f8eb9931558d719e0c56144
-Directory: 3.5.5/scala2.12-java11-python3-r-ubuntu
+GitCommit: c264d48dc510018095700ed33e700ccc34268bf2
+Directory: 3.5.6/scala2.12-java11-python3-r-ubuntu
-Tags: 3.5.5-scala2.12-java11-python3-ubuntu, 3.5.5-python3, 3.5.5
+Tags: 3.5.6-scala2.12-java11-python3-ubuntu, 3.5.6-python3, 3.5.6
Architectures: amd64, arm64v8
-GitCommit: 86f243f6df77cf247f8eb9931558d719e0c56144
-Directory: 3.5.5/scala2.12-java11-python3-ubuntu
+GitCommit: c264d48dc510018095700ed33e700ccc34268bf2
+Directory: 3.5.6/scala2.12-java11-python3-ubuntu
-Tags: 3.5.5-scala2.12-java11-r-ubuntu, 3.5.5-r
+Tags: 3.5.6-scala2.12-java11-r-ubuntu, 3.5.6-r
Architectures: amd64, arm64v8
-GitCommit: 86f243f6df77cf247f8eb9931558d719e0c56144
-Directory: 3.5.5/scala2.12-java11-r-ubuntu
+GitCommit: c264d48dc510018095700ed33e700ccc34268bf2
+Directory: 3.5.6/scala2.12-java11-r-ubuntu
-Tags: 3.5.5-scala2.12-java11-ubuntu, 3.5.5-scala
+Tags: 3.5.6-scala2.12-java11-ubuntu, 3.5.6-scala
Architectures: amd64, arm64v8
-GitCommit: 86f243f6df77cf247f8eb9931558d719e0c56144
-Directory: 3.5.5/scala2.12-java11-ubuntu
+GitCommit: c264d48dc510018095700ed33e700ccc34268bf2
+Directory: 3.5.6/scala2.12-java11-ubuntu
-Tags: 3.5.5-scala2.12-java17-python3-r-ubuntu
+Tags: 3.5.6-scala2.12-java17-python3-r-ubuntu
Architectures: amd64, arm64v8
-GitCommit: 86f243f6df77cf247f8eb9931558d719e0c56144
-Directory: 3.5.5/scala2.12-java17-python3-r-ubuntu
+GitCommit: c264d48dc510018095700ed33e700ccc34268bf2
+Directory: 3.5.6/scala2.12-java17-python3-r-ubuntu
-Tags: 3.5.5-scala2.12-java17-python3-ubuntu, 3.5.5-java17-python3, 3.5.5-java17
+Tags: 3.5.6-scala2.12-java17-python3-ubuntu, 3.5.6-java17-python3, 3.5.6-java17
Architectures: amd64, arm64v8
-GitCommit: 86f243f6df77cf247f8eb9931558d719e0c56144
-Directory: 3.5.5/scala2.12-java17-python3-ubuntu
+GitCommit: c264d48dc510018095700ed33e700ccc34268bf2
+Directory: 3.5.6/scala2.12-java17-python3-ubuntu
-Tags: 3.5.5-scala2.12-java17-r-ubuntu, 3.5.5-java17-r
+Tags: 3.5.6-scala2.12-java17-r-ubuntu, 3.5.6-java17-r
Architectures: amd64, arm64v8
-GitCommit: 86f243f6df77cf247f8eb9931558d719e0c56144
-Directory: 3.5.5/scala2.12-java17-r-ubuntu
+GitCommit: c264d48dc510018095700ed33e700ccc34268bf2
+Directory: 3.5.6/scala2.12-java17-r-ubuntu
-Tags: 3.5.5-scala2.12-java17-ubuntu, 3.5.5-java17-scala
+Tags: 3.5.6-scala2.12-java17-ubuntu, 3.5.6-java17-scala
Architectures: amd64, arm64v8
-GitCommit: 86f243f6df77cf247f8eb9931558d719e0c56144
-Directory: 3.5.5/scala2.12-java17-ubuntu
+GitCommit: c264d48dc510018095700ed33e700ccc34268bf2
+Directory: 3.5.6/scala2.12-java17-ubuntu
Tags: 4.0.0-scala2.13-java17-python3-r-ubuntu
Architectures: amd64, arm64v8
diff --git a/_bashbrew-list b/_bashbrew-list
index 2e85a15..ac36708 100644
--- a/_bashbrew-list
+++ b/_bashbrew-list
@@ -1,19 +1,19 @@
-spark:3.5.5
-spark:3.5.5-java17
-spark:3.5.5-java17-python3
-spark:3.5.5-java17-r
-spark:3.5.5-java17-scala
-spark:3.5.5-python3
-spark:3.5.5-r
-spark:3.5.5-scala
-spark:3.5.5-scala2.12-java11-python3-r-ubuntu
-spark:3.5.5-scala2.12-java11-python3-ubuntu
-spark:3.5.5-scala2.12-java11-r-ubuntu
-spark:3.5.5-scala2.12-java11-ubuntu
-spark:3.5.5-scala2.12-java17-python3-r-ubuntu
-spark:3.5.5-scala2.12-java17-python3-ubuntu
-spark:3.5.5-scala2.12-java17-r-ubuntu
-spark:3.5.5-scala2.12-java17-ubuntu
+spark:3.5.6
+spark:3.5.6-java17
+spark:3.5.6-java17-python3
+spark:3.5.6-java17-r
+spark:3.5.6-java17-scala
+spark:3.5.6-python3
+spark:3.5.6-r
+spark:3.5.6-scala
+spark:3.5.6-scala2.12-java11-python3-r-ubuntu
+spark:3.5.6-scala2.12-java11-python3-ubuntu
+spark:3.5.6-scala2.12-java11-r-ubuntu
+spark:3.5.6-scala2.12-java11-ubuntu
+spark:3.5.6-scala2.12-java17-python3-r-ubuntu
+spark:3.5.6-scala2.12-java17-python3-ubuntu
+spark:3.5.6-scala2.12-java17-r-ubuntu
+spark:3.5.6-scala2.12-java17-ubuntu
spark:4.0.0
spark:4.0.0-java21
spark:4.0.0-java21-python3
diff --git a/_bashbrew-list-build-order b/_bashbrew-list-build-order
index 7ec4e03..99d369b 100644
--- a/_bashbrew-list-build-order
+++ b/_bashbrew-list-build-order
@@ -1,15 +1,15 @@
-spark:3.5.5-java17-scala
-spark:3.5.5-scala
-spark:3.5.5-scala2.12-java11-python3-r-ubuntu
-spark:3.5.5-scala2.12-java17-python3-r-ubuntu
+spark:3.5.6-java17-scala
+spark:3.5.6-scala
+spark:3.5.6-scala2.12-java11-python3-r-ubuntu
+spark:3.5.6-scala2.12-java17-python3-r-ubuntu
spark:4.0.0-java21-scala
spark:4.0.0-scala2.13-java21-python3-r-ubuntu
spark:latest
spark:scala
-spark:3.5.5
-spark:3.5.5-java17
-spark:3.5.5-java17-r
-spark:3.5.5-r
+spark:3.5.6
+spark:3.5.6-java17
+spark:3.5.6-java17-r
+spark:3.5.6-r
spark:4.0.0-java21-r
spark:4.0.0-scala2.13-java17-python3-r-ubuntu
spark:python3-java17
diff --git a/spark_3.5.5-java17-r/Dockerfile b/spark_3.5.6-java17-r/Dockerfile
similarity index 95%
rename from spark_3.5.5-java17-r/Dockerfile
rename to spark_3.5.6-java17-r/Dockerfile
index 1fdf9b9..204f72b 100644
--- a/spark_3.5.5-java17-r/Dockerfile
+++ b/spark_3.5.6-java17-r/Dockerfile
@@ -14,7 +14,7 @@
# See the License for the specific language governing permissions and
# limitations under the License.
#
-FROM spark:3.5.5-scala2.12-java17-ubuntu
+FROM spark:3.5.6-scala2.12-java17-ubuntu
USER root
diff --git a/spark_3.5.5-java17-scala/Dockerfile b/spark_3.5.6-java17-scala/Dockerfile
similarity index 95%
rename from spark_3.5.5-java17-scala/Dockerfile
rename to spark_3.5.6-java17-scala/Dockerfile
index fc83654..2f55374 100644
--- a/spark_3.5.5-java17-scala/Dockerfile
+++ b/spark_3.5.6-java17-scala/Dockerfile
@@ -36,9 +36,9 @@ RUN set -ex; \
# Install Apache Spark
# https://downloads.apache.org/spark/KEYS
-ENV SPARK_TGZ_URL=https://archive.apache.org/dist/spark/spark-3.5.5/spark-3.5.5-bin-hadoop3.tgz \
- SPARK_TGZ_ASC_URL=https://archive.apache.org/dist/spark/spark-3.5.5/spark-3.5.5-bin-hadoop3.tgz.asc \
- GPG_KEY=F28C9C925C188C35E345614DEDA00CE834F0FC5C
+ENV SPARK_TGZ_URL=https://archive.apache.org/dist/spark/spark-3.5.6/spark-3.5.6-bin-hadoop3.tgz \
+ SPARK_TGZ_ASC_URL=https://archive.apache.org/dist/spark/spark-3.5.6/spark-3.5.6-bin-hadoop3.tgz.asc \
+ GPG_KEY=0FE4571297AB84440673665669600C8338F65970
RUN set -ex; \
export SPARK_TMP="$(mktemp -d)"; \
diff --git a/spark_3.5.5-java17-scala/entrypoint.sh b/spark_3.5.6-java17-scala/entrypoint.sh
similarity index 100%
rename from spark_3.5.5-java17-scala/entrypoint.sh
rename to spark_3.5.6-java17-scala/entrypoint.sh
diff --git a/spark_3.5.5-java17/Dockerfile b/spark_3.5.6-java17/Dockerfile
similarity index 95%
rename from spark_3.5.5-java17/Dockerfile
rename to spark_3.5.6-java17/Dockerfile
index d9fb2f4..e175f84 100644
--- a/spark_3.5.5-java17/Dockerfile
+++ b/spark_3.5.6-java17/Dockerfile
@@ -14,7 +14,7 @@
# See the License for the specific language governing permissions and
# limitations under the License.
#
-FROM spark:3.5.5-scala2.12-java17-ubuntu
+FROM spark:3.5.6-scala2.12-java17-ubuntu
USER root
diff --git a/spark_3.5.5-r/Dockerfile b/spark_3.5.6-r/Dockerfile
similarity index 95%
rename from spark_3.5.5-r/Dockerfile
rename to spark_3.5.6-r/Dockerfile
index 7beaf3f..7f8a4dd 100644
--- a/spark_3.5.5-r/Dockerfile
+++ b/spark_3.5.6-r/Dockerfile
@@ -14,7 +14,7 @@
# See the License for the specific language governing permissions and
# limitations under the License.
#
-FROM spark:3.5.5-scala2.12-java11-ubuntu
+FROM spark:3.5.6-scala2.12-java11-ubuntu
USER root
diff --git a/spark_3.5.5-scala/Dockerfile b/spark_3.5.6-scala/Dockerfile
similarity index 95%
rename from spark_3.5.5-scala/Dockerfile
rename to spark_3.5.6-scala/Dockerfile
index 2adc6a6..d309bf8 100644
--- a/spark_3.5.5-scala/Dockerfile
+++ b/spark_3.5.6-scala/Dockerfile
@@ -36,9 +36,9 @@ RUN set -ex; \
# Install Apache Spark
# https://downloads.apache.org/spark/KEYS
-ENV SPARK_TGZ_URL=https://archive.apache.org/dist/spark/spark-3.5.5/spark-3.5.5-bin-hadoop3.tgz \
- SPARK_TGZ_ASC_URL=https://archive.apache.org/dist/spark/spark-3.5.5/spark-3.5.5-bin-hadoop3.tgz.asc \
- GPG_KEY=F28C9C925C188C35E345614DEDA00CE834F0FC5C
+ENV SPARK_TGZ_URL=https://archive.apache.org/dist/spark/spark-3.5.6/spark-3.5.6-bin-hadoop3.tgz \
+ SPARK_TGZ_ASC_URL=https://archive.apache.org/dist/spark/spark-3.5.6/spark-3.5.6-bin-hadoop3.tgz.asc \
+ GPG_KEY=0FE4571297AB84440673665669600C8338F65970
RUN set -ex; \
export SPARK_TMP="$(mktemp -d)"; \
diff --git a/spark_3.5.5-scala/entrypoint.sh b/spark_3.5.6-scala/entrypoint.sh
similarity index 100%
rename from spark_3.5.5-scala/entrypoint.sh
rename to spark_3.5.6-scala/entrypoint.sh
diff --git a/spark_3.5.5-scala2.12-java17-python3-r-ubuntu/Dockerfile b/spark_3.5.6-scala2.12-java11-python3-r-ubuntu/Dockerfile
similarity index 96%
rename from spark_3.5.5-scala2.12-java17-python3-r-ubuntu/Dockerfile
rename to spark_3.5.6-scala2.12-java11-python3-r-ubuntu/Dockerfile
index a900883..a6bf459 100644
--- a/spark_3.5.5-scala2.12-java17-python3-r-ubuntu/Dockerfile
+++ b/spark_3.5.6-scala2.12-java11-python3-r-ubuntu/Dockerfile
@@ -14,7 +14,7 @@
# See the License for the specific language governing permissions and
# limitations under the License.
#
-FROM spark:3.5.5-scala2.12-java17-ubuntu
+FROM spark:3.5.6-scala2.12-java11-ubuntu
USER root
diff --git a/spark_3.5.5-scala2.12-java11-python3-r-ubuntu/Dockerfile b/spark_3.5.6-scala2.12-java17-python3-r-ubuntu/Dockerfile
similarity index 96%
rename from spark_3.5.5-scala2.12-java11-python3-r-ubuntu/Dockerfile
rename to spark_3.5.6-scala2.12-java17-python3-r-ubuntu/Dockerfile
index b5127ed..9f39101 100644
--- a/spark_3.5.5-scala2.12-java11-python3-r-ubuntu/Dockerfile
+++ b/spark_3.5.6-scala2.12-java17-python3-r-ubuntu/Dockerfile
@@ -14,7 +14,7 @@
# See the License for the specific language governing permissions and
# limitations under the License.
#
-FROM spark:3.5.5-scala2.12-java11-ubuntu
+FROM spark:3.5.6-scala2.12-java17-ubuntu
USER root
diff --git a/spark_3.5.5/Dockerfile b/spark_3.5.6/Dockerfile
similarity index 95%
rename from spark_3.5.5/Dockerfile
rename to spark_3.5.6/Dockerfile
index 5c3033d..5d63326 100644
--- a/spark_3.5.5/Dockerfile
+++ b/spark_3.5.6/Dockerfile
@@ -14,7 +14,7 @@
# See the License for the specific language governing permissions and
# limitations under the License.
#
-FROM spark:3.5.5-scala2.12-java11-ubuntu
+FROM spark:3.5.6-scala2.12-java11-ubuntu
USER root Relevant Maintainers:
|
tianon
approved these changes
May 29, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR proposes to update Spark 3.5 to its latest 3.5.6.