Skip to content

apontador/docker-spark

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

spark

A debian:jessie based Spark container. Use it in a standalone cluster with the accompanying docker-compose.yml, or as a base for more complex recipes.

example

To create a standalone cluster with docker-compose:

docker-compose up

The SparkUI will be running at http://${YOUR_DOCKER_HOST}:8080 with one worker listed. To run spark-shell, exec into a container:

docker exec -it dockerspark_master_1 /bin/bash
/usr/spark/bin/spark-shell --master spark://master:7077

To run SparkPi, exec into a container:

docker exec -it dockerspark_master_1 /bin/bash
MASTER=spark://master:7077 /usr/spark/bin/run-example SparkPi 10

license

MIT

About

Docker build for Apache Spark

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published