Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-4954][Core] add spark version infomation in log for standalone mode #3790

Closed

Conversation

liyezhang556520
Copy link
Contributor

The master and worker spark version may be not the same with Driver spark version. That is because spark Jar file might be replaced for new application without restarting the spark cluster. So there shall log out the spark-version in both Mater and Worker log.

@SparkQA
Copy link

SparkQA commented Dec 24, 2014

Test build #24781 has started for PR 3790 at commit e05e1e3.

  • This patch merges cleanly.

@SparkQA
Copy link

SparkQA commented Dec 24, 2014

Test build #24781 has finished for PR 3790 at commit e05e1e3.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24781/
Test PASSed.

@pwendell
Copy link
Contributor

Looks good - but can we use the exact same wording in both cases? It will be obvious from the previous log message whether it is the master or worker:

I'd just say "Running Spark version XXX", the same as in 39272c8#diff-364713d7776956cb8b0a771e9b62f82dR176

@pwendell
Copy link
Contributor

Actually I can just merge this and add the fix.

@asfgit asfgit closed this in 786808a Dec 27, 2014
@liyezhang556520 liyezhang556520 deleted the version4Standalone branch December 29, 2014 07:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
4 participants