Spark Tutorial

Apache Spark tutorial using Zeppelin notebooks.

Requirement: Docker installed and running.

Open the Terminal and enter the tutotial folder:

$ cd /path/to/spark-tutorial

Then, execute the following command:

$ docker run -p 8080:8080 --rm -v $PWD/data:/data -v $PWD/notebook:/notebook -e ZEPPELIN_NOTEBOOK_DIR='/notebook' --name zeppelin apache/zeppelin:0.8.1

This command will download the Zeppelin dependencies (approximately 3GB) and run it.

To see if Zeppelin is running and the notebooks available, visit the URL localhost:8080/

Test if Zeppelin is working by opening the notebook with the Word Count example:

• Word Count - Scala
• Word Count - Python

To execute the codes in the notebooks, click the play button or select the paragraph and use the shortcut Shift + Enter

Other notebooks available:

• Outlier Detection: An ETL Tutorial with Spark - Scala
• Outlier Detection: An ETL Tutorial with Spark - Python