From 5d84e0e9285aec53aa9c57d64313c0e513e41d30 Mon Sep 17 00:00:00 2001 From: Andrew Ash Date: Tue, 17 Jun 2014 10:43:33 -0700 Subject: [PATCH] Document new port configuration options - spark.fileserver.port - spark.broadcast.port - spark.replClassServer.port - spark.blockManager.port --- docs/spark-standalone.md | 41 +++++++++++++++++++++++++++++----------- 1 file changed, 30 insertions(+), 11 deletions(-) diff --git a/docs/spark-standalone.md b/docs/spark-standalone.md index ad8b6c0e51a78..2183c54f8c672 100644 --- a/docs/spark-standalone.md +++ b/docs/spark-standalone.md @@ -322,7 +322,7 @@ configure those ports. Browser - Driver + Application 4040 Web UI spark.ui.port @@ -372,18 +372,37 @@ configure those ports. - Driver and other Workers Worker + Application (random) - - - - None - Jetty-based. Each of these services starts on a random port that cannot be configured + File server for files and jars + spark.fileserver.port + Jetty-based + + + Worker + Application + (random) + HTTP Broadcast + spark.broadcast.port + Jetty-based. Not used by TorrentBroadcast, which sends data through the block manager + instead + + + Worker + Spark Shell + (random) + Class file server (Spark Shell only) + spark.replClassServer.port + Jetty-based + + + Worker + Other Workers + (random) + Block Manager port + spark.blockManager.port + Raw socket via ServerSocketChannel