Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SPARK-28921: Use latest kubernetes client for 2.3 branch #25637

Closed
wants to merge 2 commits into from

Conversation

@andygrove
Copy link
Member

@andygrove andygrove commented Aug 30, 2019

What changes were proposed in this pull request?

Upgrade the version of kubernets-client JAR

Why are the changes needed?

It is no longer possible to run Spark 2.3 jobs on certain EKS versions since AWS patched some CVEs in the past couple days

Does this PR introduce any user-facing change?

No

How was this patch tested?

I manually verified that this works, by using spark-submit to deploy to EKS.

@andygrove
Copy link
Member Author

@andygrove andygrove commented Aug 30, 2019

we may need to add some exclusions because the latest kubernetes client uses jackson 2.9.9 instead of 2.7.7 ...

Loading

@AmplabJenkins
Copy link

@AmplabJenkins AmplabJenkins commented Aug 30, 2019

Can one of the admins verify this patch?

Loading

@andygrove andygrove changed the title SPARK-28921: Use latest kubernetes client for 2.3 branch [WIP] SPARK-28921: Use latest kubernetes client for 2.3 branch Aug 31, 2019
@dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Aug 31, 2019

Thank you for making a PR, @andygrove . However, 2.3.4 was the last release and branch-2.3 became EOL according to our release cadence. I'll close this PR.

cc @kiszk since he was a release manager for 2.3.4.

Loading

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants