Skip to content

Commit

Permalink
Change install order for spark flavor
Browse files Browse the repository at this point in the history
  • Loading branch information
lukasmasuch committed Oct 4, 2019
1 parent 67b316b commit bf99878
Showing 1 changed file with 7 additions and 7 deletions.
14 changes: 7 additions & 7 deletions spark-flavor/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -32,13 +32,19 @@ RUN \
# Cleanup
clean-layer.sh

# Install Zeppelin
RUN \
/bin/bash $RESOURCES_PATH/tools/zeppelin.sh --install && \
# Cleanup
clean-layer.sh

# Install spark python libraries
RUN \
# pyspark
pip install --no-cache-dir \
findspark \
pyarrow \
spark-sklearn \
# downgrades sklearn: spark-sklearn \
# Improved performance: https://github.com/mozilla/jupyter-spark
lxml \
# Spylon - Jupyter kernel for scala and spark
Expand Down Expand Up @@ -78,12 +84,6 @@ RUN \
# Cleanup
clean-layer.sh

# Install Zeppelin
RUN \
/bin/bash $RESOURCES_PATH/tools/zeppelin.sh --install && \
# Cleanup
clean-layer.sh

# R Spark support
ENV R_LIBS_USER $SPARK_HOME/R/lib

Expand Down

0 comments on commit bf99878

Please sign in to comment.