[SPARK-2608] fix executor backend launch commond over mesos mode

[scwf]

mesos scheduler backend use spark-class/spark-executor to launch executor backend, this will lead to problems:
1 when set spark.executor.extraJavaOptions CoarseMesosSchedulerBackend will throw errors because of the launch command "./bin/spark-class org.apache.spark.executor.CoarseGrainedExecutorBackend %s %s %s %s %d").format(basename, extraOpts, driverUrl, offer.getSlaveId.getValue,offer.getHostname, numCores))

2 spark.executor.extraJavaOptions and spark.executor.extraLibraryPath set in sparkconf will not be valid

[AmplabJenkins]

Can one of the admins verify this patch?

[pwendell]

Jenkins, test this please.

[SparkQA]

QA tests have started for PR 1513. This patch merges cleanly.
View progress: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/17650/consoleFull

[SparkQA]

QA results for PR 1513:
- This patch FAILED unit tests.
- This patch merges cleanly
- This patch adds no public classes

For more information see test ouptut:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/17650/consoleFull

[tnachen]

I was considering a similar fix but I wasnt sure if computing all the class paths and options here where the task is submitted is safe versus in spark-class
Where the executor is running is safe. Now thinking about it I think it should usually work but might not when the executor starts to run in another environment as the framework (like in docker). I have a pr with another fix but I think we should use this PR instead for now

[scwf]

@pwendell , i can not see the failed unit test info, can you give me some infer

[pwendell]

Jenkins, retest this please.

[SparkQA]

QA tests have started for PR 1513. This patch merges cleanly.
View progress: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/18005/consoleFull

[SparkQA]

QA results for PR 1513:
- This patch FAILED unit tests.
- This patch merges cleanly
- This patch adds no public classes

For more information see test ouptut:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/18005/consoleFull

[tnachen]

It looks it's not failing unit tests but can't even compile.

[scwf]

it's becaude [SPARK-2260] update Command.scala, i will fix it

[scwf]

@pwendell i have fixed compile error, can you retest this pr?

[andrewor14]

test this please

[SparkQA]

QA tests have started for PR 1513. This patch merges cleanly.
View progress: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/18185/consoleFull

[SparkQA]

QA results for PR 1513:
- This patch PASSES unit tests.
- This patch merges cleanly
- This patch adds no public classes

For more information see test ouptut:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/18185/consoleFull

[scwf]

@pwendell , can you verify this pr? thanks~