Spark Submitter Console is a tinny but useful web console in which you can
- Uploading jar
- Submitting jar to Yarn cluster
- Monitoring/Manager your applications:
-
Clone and package:
mvn clean package -DskipTests -Pshade
-
find the spark_jobs_2017-08-20.sql in resources directory and import to MySQL.
-
Create /tmp/jdbc.properties like this:
url=jdbc:mysql://127.0.0.1:3306/spark_jobs?useUnicode=true&characterEncoding=utf8 userName=xxxx password=xxx
-
Find the jar and start it:
java -cp .:[your jar path] tech.mlsql.spark.submitter.SparkSubmitterConsoleApp \
-yarnUrl http://127.0.0.1 \
-jdbcPath /tmp/jdbc.properties
- Only support Yarn Cluster
- No Auth available. We recommend you to placed it behind Nginx which can provide the auth.
- No high availability design