[SPARK-35222] In YARN mode, the tracking URL is printed to allow users to better track Spark Job #32336
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…only the AppID is printed, but the Tracking URL is also printed to allow users to better track Spark Job
|
Can one of the admins verify this patch? |
|
We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What changes were proposed in this pull request?
In YARN mode, for better user experience, when Spark is started, not only the AppID is printed, but the Tracking URL is also printed to allow users to better track Spark Job
Why are the changes needed?
In practice, the user needs to track the Spark task through the YARN Trackting URL. At the moment, it is just printing the appId, which is a bit of a nuisance for the user to use. You need to look up YARN and find the corresponding app. If the trackting URL information is available, the user can open the URL connection directly，This improves the user experience
Does this PR introduce any user-facing change?
no
How was this patch tested?
This just prints the tracking URL, so they won't cause behaviour change. So passing the existing tests should be enough.