Skip to content

Commit

Permalink
[SPARK-12413] Fix Mesos ZK persistence
Browse files Browse the repository at this point in the history
I believe this fixes SPARK-12413.  I'm currently running an integration test to verify.

Author: Michael Gummelt <mgummelt@mesosphere.io>

Closes #10366 from mgummelt/fix-zk-mesos.
  • Loading branch information
Michael Gummelt authored and sarutak committed Dec 18, 2015
1 parent 40e52a2 commit 2bebaa3
Showing 1 changed file with 5 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -99,7 +99,11 @@ private[mesos] class MesosSubmitRequestServlet(
// cause spark-submit script to look for files in SPARK_HOME instead.
// We only need the ability to specify where to find spark-submit script
// which user can user spark.executor.home or spark.home configurations.
val environmentVariables = request.environmentVariables.filterKeys(!_.equals("SPARK_HOME"))
//
// Do not use `filterKeys` here to avoid SI-6654, which breaks ZK persistence
val environmentVariables = request.environmentVariables.filter { case (k, _) =>
k != "SPARK_HOME"
}
val name = request.sparkProperties.get("spark.app.name").getOrElse(mainClass)

// Construct driver description
Expand Down

0 comments on commit 2bebaa3

Please sign in to comment.