-
Notifications
You must be signed in to change notification settings - Fork 864
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[KYUUBI #6321] Support to get Spark Kubernetes app URL
# 馃攳 Description ## Issue References 馃敆 Now for kubernetes application, there is no runtime AppURL return in the application report. In fact, we can get the driver svc and get the spark-ui port, then build the Spark UI URL same with that of spark. https://github.com/apache/spark/blob/074ddc2825674edcea1bb7febf2c6d8b27c2e375/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/DriverServiceFeatureStep.scala#L67 https://github.com/apache/spark/blob/074ddc2825674edcea1bb7febf2c6d8b27c2e375/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/DriverServiceFeatureStep.scala#L96-L102 Service Selector example: ``` selector: kyuubi-unique-tag: bf5fa281-0b2f-4096-aa0a-13a463c147a6 spark-app-selector: spark-bf074093a7994954a89101eb2831bd1e ``` ## Describe Your Solution 馃敡 Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change. ## Types of changes 馃敄 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 馃И #### Behavior Without This Pull Request 鈿帮笍 #### Behavior With This Pull Request 馃帀 #### Related Unit Tests --- # Checklist 馃摑 - [ ] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6318 from turboFei/k8s_spark_ui. Closes #6321 f77999e [Wang, Fei] with label selector does not work 4e8d576 [Wang, Fei] typo 3f1eb54 [Wang, Fei] comments 6f0d01d [Wang, Fei] ut 9edfde0 [Wang, Fei] ut 65d5e81 [Wang, Fei] using pattern 9b21d30 [Wang, Fei] Support to get kubernetes app url Authored-by: Wang, Fei <fwang12@ebay.com> Signed-off-by: Wang, Fei <fwang12@ebay.com>
- Loading branch information
Showing
4 changed files
with
176 additions
and
28 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.