Support displaying Auron build info in Spark UI #1409
Description
This feature primarily displays Auron information, such as Auron’s build details and transformation status, in the Spark UI for users to view.
Set the parameter to enable or disable this feature. Parameter: spark.auron.ui.enabled — true to enable, false to disable.
1. the Spark application is running
When the Spark application is running, the Spark UI will display AURON SQL / DataFrame, showing Auron’s build information.
The information displayed in the Spark UI is as follows:
2. after the Spark application ends
After the Spark application ends, the information can be viewed through the Spark History Server.
You only need to package the auron-spark-ui project into a JAR and integrate it with the Spark History Server, so that the information can be viewed through the Spark History Server after the job finishes.
eg:
auron-spark-ui_2.12-7.0.0-SNAPSHOT.jar to shs jars
The information displayed in the Spark UI from Spark history server is as follows:
