Apache Livy Docker Container

Based on the latest release of the Apache Livy project

---

Supported Versions:

Livy-Server: 0.5.0

Apache Spark: 2.3.1

Python: Python3 (including boto3 1.9)

---

Configuration

Required environment variables:

• SPARK_MASTER_ENDPOINT => Spark Master IP
• SPARK_MASTER_PORT => Spark Master Port
• DEPLOY_MODE => client for PySpark applications and preferably cluster for Java/Scala applications

Per default the /tmp folder is configured as path for submitting local files via Livy Server

Livy Server start on default port 8998

---

Usage:

docker run -d -p 8998:8998 -e SPARK_MASTER_ENDPOINT=1.2.3.4 -e SPARK_MASTER_PORT=7077 -v /tmp:/tmp cloudiator/livy-server-docker:latest