Skip to content

A dockerized version of Spark 2.3.0 for use in k8s

Notifications You must be signed in to change notification settings

eliiza/spark-standalone

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

While Spark 2.3 adds support for native k8s, Python and R drivers are still in development.

This docker image, instead, allows the deployment of Spark Standalone in k8s with R support

To run locally:

$ docker-compose up

And to scale up the workers to 3 nodes

$ docker-compose up --scale slave=3

About

A dockerized version of Spark 2.3.0 for use in k8s

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages