Skip to content
Deploy your Spark Production Cluster on Kubernetes
Dockerfile Shell
Branch: master
Clone or download

Latest commit

Files

Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
docker-compose
kubernetes Fix Links and Docker compose Mar 12, 2020
spark-container
LICENSE
README.md

README.md

Deploy Spark Production Cluster on Kubernetes

Yarn has been the default orchestration platform for tools from Hadoop ecosystem. This has started changing in recent times. Especially with Spark, which integrates very well with storage platforms like S3 and isn't tightly coupled with other Hadoop ecosystem tools.

Refer this post for detailed steps on deploying Spark on Kubernetes: https://developer.sh/posts/spark-kubernetes-guide

You can’t perform that action at this time.