Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SW-2612] Change K8s Base Image for Spark 2.4 to openjdk:8-jdk-slim-buster #2637

Merged
merged 5 commits into from
Sep 16, 2021

Conversation

mn-mikke
Copy link
Collaborator

@mn-mikke mn-mikke commented Sep 15, 2021

openjdk:8-jdk-slim used to be based on the buster (debian apt) repository:

/etc/apt/sources.list:# deb http://snapshot.debian.org/archive/debian/20210621T000000Z buster main
/etc/apt/sources.list:deb http://deb.debian.org/debian buster main
/etc/apt/sources.list:# deb http://snapshot.debian.org/archive/debian-security/20210621T000000Z buster/updates main
/etc/apt/sources.list:deb http://security.debian.org/debian-security buster/updates main
/etc/apt/sources.list:# deb http://snapshot.debian.org/archive/debian/20210621T000000Z buster-updates main
/etc/apt/sources.list:deb http://deb.debian.org/debian buster-updates main

now it's based on the bullseye (debian apt) repository:

/etc/apt/sources.list:# deb http://snapshot.debian.org/archive/debian/20210902T000000Z bullseye main
/etc/apt/sources.list:deb http://deb.debian.org/debian bullseye main
/etc/apt/sources.list:# deb http://snapshot.debian.org/archive/debian-security/20210902T000000Z bullseye-security main
/etc/apt/sources.list:deb http://security.debian.org/debian-security bullseye-security main
/etc/apt/sources.list:# deb http://snapshot.debian.org/archive/debian/20210902T000000Z bullseye-updates main
/etc/apt/sources.list:deb http://deb.debian.org/debian bullseye-updates main

This repository change causes failure of building spark-py docker image for the version 2.4. The newer repo is missing packages for python 2.7.

This PR changes the base image for Spark 2.4 images to openjdk:8-jdk-slim-buster. The change was manually verified on EKS cluster.

@mn-mikke mn-mikke changed the title [SW-2612] Change K8s Base Image for Spark 2.4 to openjdk:11-jre-slim [SW-2612] Change K8s Base Image for Spark 2.4 to openjdk:8-jdk-slim-buster Sep 16, 2021
@mn-mikke mn-mikke merged commit dd09dca into master Sep 16, 2021
@mn-mikke mn-mikke deleted the mn/SW-2612 branch September 16, 2021 18:33
mn-mikke added a commit that referenced this pull request Sep 16, 2021
…uster (#2637)

* [SW-2612] Change K8s Base Image for Spark 2.4 to openjdk:11-jre-slim

* Update Docker Image Version

* change to 8-jdk-slim-buster

* Update Docker Image Version

Co-authored-by: h2o-ops <h2o-ops@h2o.ai>
(cherry picked from commit dd09dca)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants