[SPARK-18171][MESOS] Show correct framework address in mesos master web ui when the advertised address is used

[lins05]

What changes were proposed in this pull request?

In SPARK-4563 we added the support for the driver to advertise a different hostname/ip (spark.driver.host to the executors other than the hostname/ip the driver actually binds to (spark.driver.bindAddress). But in the mesos webui's frameworks page, it still shows the driver's binds hostname/ip (though the web ui link is correct). We should fix it to make them consistent.

Before:

After:

This PR doesn't affect the behavior on the spark side, only makes the display on the mesos master side more consistent.

How was this patch tested?

Manual test.

• Build the package and build a docker image (spark:2.1-test)

./dev/make-distribution.sh -Phadoop-2.6 -Phive -Phive-thriftserver -Pyarn -Pmesos

• Then run the spark driver inside a docker container.

docker run --rm -it \
  --name=spark \
  -p 30000-30010:30000-30010 \
  -e LIBPROCESS_ADVERTISE_IP=172.17.42.1 \
  -e LIBPROCESS_PORT=30000 \
  -e MESOS_NATIVE_LIBRARY=/usr/local/lib/libmesos-1.0.0.so \
  -e MESOS_NATIVE_JAVA_LIBRARY=/usr/local/lib/libmesos-1.0.0.so \
  -e SPARK_HOME=/opt/dist \
  spark:2.1-test

• Inside the container, launch the spark driver, making use of the advertised address:

/opt/dist/bin/spark-shell \
  --master mesos://zk://172.17.42.1:2181/mesos \
  --conf spark.driver.host=172.17.42.1 \
  --conf spark.driver.bindAddress=172.17.0.1 \
  --conf spark.driver.port=30001 \
  --conf spark.driver.blockManager.port=30002 \
  --conf spark.ui.port=30003 \
  --conf spark.mesos.coarse=true \
  --conf spark.cores.max=2 \
  --conf spark.executor.cores=1 \
  --conf spark.executor.memory=1g \
  --conf spark.mesos.executor.docker.image=spark:2.1-test

• Run several spark jobs to ensure everything is running fine.

val rdd = sc.textFile("file:///opt/dist/README.md")
rdd.cache().count

[SparkQA]

Test build #67778 has finished for PR 15684 at commit 19a4261.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[lins05]

/cc @zsxwing who worked on SPARK-4563 and @mgummelt .

[lins05]

@zsxwing @mgummelt could you help review this PR?

[tnachen]

LGTM, @srowen can you help on this?

[srowen]

Merged to master