This container runs a Spark server accepting jobs through Livy.
This uses mainly files found in the spark directory for configuration.
The connection to MinIO in particular, is found in the spark-defaults.conf file.
To connect to Spark in the container through PySpark, run the pyspark.sh script.