Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SPARK-28921: Use latest kubernetes client for 2.3 branch #25637

Closed
wants to merge 2 commits into from

Conversation

@andygrove
Copy link
Contributor

commented Aug 30, 2019

What changes were proposed in this pull request?

Upgrade the version of kubernets-client JAR

Why are the changes needed?

It is no longer possible to run Spark 2.3 jobs on certain EKS versions since AWS patched some CVEs in the past couple days

Does this PR introduce any user-facing change?

No

How was this patch tested?

I manually verified that this works, by using spark-submit to deploy to EKS.

@andygrove

This comment has been minimized.

Copy link
Contributor Author

commented Aug 30, 2019

we may need to add some exclusions because the latest kubernetes client uses jackson 2.9.9 instead of 2.7.7 ...

@AmplabJenkins

This comment has been minimized.

Copy link

commented Aug 30, 2019

Can one of the admins verify this patch?

@andygrove andygrove changed the title SPARK-28921: Use latest kubernetes client for 2.3 branch [WIP] SPARK-28921: Use latest kubernetes client for 2.3 branch Aug 31, 2019

@dongjoon-hyun

This comment has been minimized.

Copy link
Member

commented Aug 31, 2019

Thank you for making a PR, @andygrove . However, 2.3.4 was the last release and branch-2.3 became EOL according to our release cadence. I'll close this PR.

cc @kiszk since he was a release manager for 2.3.4.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
3 participants
You can’t perform that action at this time.