Spark On Kubernetes from zero to hero manual setup
-
Updated
Aug 29, 2022 - Dockerfile
Spark On Kubernetes from zero to hero manual setup
Docker images for spark on kubernetes
Using python3.6 alpine base image adds java,pandas, numpy,pyspark and spark as rundeps. This image can be used as container image when you run spark-submit on k8.
Add a description, image, and links to the spark-on-kubernetes topic page so that developers can more easily learn about it.
To associate your repository with the spark-on-kubernetes topic, visit your repo's landing page and select "manage topics."