Skip to content

Commit

Permalink
add coment for hack why PYSPARK_PYTHON is needed in spark-submit
Browse files Browse the repository at this point in the history
  • Loading branch information
Ken Takagiwa authored and Ken Takagiwa committed Jul 16, 2014
1 parent a7a0b5c commit 0a516f5
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion bin/spark-submit
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,7 @@ DEPLOY_MODE=${DEPLOY_MODE:-"client"}
# pythonExec(which python Spark should execute).
# Since pyprint is located in DStream, Spark does not know which python should use.
# In that case, get python path from PYSPARK_PYTHON, environmental variable.
# This fix is ongoing in print branch in my repo.
# This fix is ongoing in print branch in https://github.com/giwa/spark/tree/print.

# Figure out which Python executable to use
if [[ -z "$PYSPARK_PYTHON" ]]; then
Expand Down

0 comments on commit 0a516f5

Please sign in to comment.