[ZEPPELIN-6067] Add docker-compose file for running with Spark

[ParkGyeongTae]

What is this PR for?

Provide a YAML file that creates Apache Zeppelin and Apache Spark containers together using the docker compose command.

What type of PR is it?

Improvement

Todos

• - Update .gitignore
• - Add docker-compose-with-spark.yml
• - Update READMD.md

What is the Jira issue?

https://issues.apache.org/jira/projects/ZEPPELIN/issues/ZEPPELIN-6067

How should this be tested?

• Install Spark binary

cd scripts/docker/zeppelin-quick-start
wget https://archive.apache.org/dist/spark/spark-3.5.2/spark-3.5.2-bin-hadoop3.tgz
tar -xvf spark-3.5.2-bin-hadoop3.tgz

• docker compose -f docker-compose-with-spark.yml up
• Run paragraph

%spark.conf

SPARK_HOME /opt/spark
spark.master spark://spark-master:7077

• Run paragraph

%spark

val sdf = spark.createDataFrame(Seq((0, "park", 13, 70, "Korea"), (1, "xing", 14, 80, "China"), (2, "john", 15, 90, "USA"))).toDF("id", "name", "age", "score", "country")
sdf.printSchema
sdf.show()

• Result

root
 |-- id: integer (nullable = false)
 |-- name: string (nullable = true)
 |-- age: integer (nullable = false)
 |-- score: integer (nullable = false)
 |-- country: string (nullable = true)

+---+----+---+-----+-------+
| id|name|age|score|country|
+---+----+---+-----+-------+
|  0|park| 13|   70|  Korea|
|  1|xing| 14|   80|  China|
|  2|john| 15|   90|    USA|
+---+----+---+-----+-------+

Screenshots (if appropriate)

• Zeppelin UI (http://localhost:8080)
  

• Spark Master UI (http://localhost:18080)
  

• Spark Worker UI (http://localhost:18081)
  

Questions:

• Does the license files need to update? No.
• Is there breaking changes for older versions? No.
• Does this needs documentation? No.

[Reamer]

LGTM

[pan3793]

why do we need to install spark out side of the container?

[pan3793]

Oh, I see, you mount the Spark binary into the container later

[ParkGyeongTae]

@pan3793
I used the mounting method because I wanted to recommend running it according to the Spark version.

[ParkGyeongTae]

@pan3793 ping :)

[github-actions]

This pull request has been inactive for over a year. If no further activity occurs within the next 30 days, it will be automatically closed. If you believe this PR is still relevant, please feel free to leave a comment or make an update. Thank you!

[github-actions]

This pull request has been automatically closed due to prolonged inactivity (over one year without updates). If you feel this was done in error or would like to continue the discussion, feel free to reopen it. Thank you for your contributions!