Skip to content

kubernetes上使用spark operator方式部署任务,并集成volcano框架

License

Notifications You must be signed in to change notification settings

NaraLuwan/spark-on-k8s-with-volcano

Repository files navigation

spark-on-k8s-with-volcano

kubernetes上使用spark operator方式部署任务,并集成volcano框架

测试步骤

  1. 安装volcano
kubectl apply -f ./volcano-install/volcano-development.yaml
  1. 参考GoogleCloudPlatform/spark-on-k8s-operator安装spark-on-k8s-operator
  2. 分别启动spark-pi-volcano-without-operator和spark-pi-volcano,修改deploy参数测试,观察执行过程

About

kubernetes上使用spark operator方式部署任务,并集成volcano框架

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages