Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[spark] Cannot run program "spark-submit" error #221

Closed
polingsky opened this issue Aug 6, 2015 · 1 comment
Closed

[spark] Cannot run program "spark-submit" error #221

polingsky opened this issue Aug 6, 2015 · 1 comment

Comments

@polingsky
Copy link

dear:

when I enter spark/ page and click add a new snippet (python or scala)
and an error showed in ./build/env/bin/hue livy_server

java.io.IOException: Cannot run program "spark-submit": error=2, No such file or directory
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1041) ~[na:1.7.0_60]
at com.cloudera.hue.livy.server.sessions.ProcessSession$.startProcess(ProcessSession.scala:43) ~[livy-assembly.jar:na]
at com.cloudera.hue.livy.server.sessions.ProcessSession$.create(ProcessSession.scala:13) ~[livy-assembly.jar:na]
at com.cloudera.hue.livy.server.ProcessSessionFactory$$anonfun$createSession$2.apply(SessionFactory.scala:36) ~[livy-assembly.jar:na]
at com.cloudera.hue.livy.server.ProcessSessionFactory$$anonfun$createSession$2.apply(SessionFactory.scala:34) ~[livy-assembly.jar:na]
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) ~[livy-assembly.jar:na]
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) ~[livy-assembly.jar:na]
at scala.concurrent.forkjoin.ForkJoinTask$AdaptedRunnableAction.exec(ForkJoinTask.java:1417) [livy-assembly.jar:na]
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:262) [livy-assembly.jar:na]
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:975) [livy-assembly.jar:na]
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1478) [livy-assembly.jar:na]
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) [livy-assembly.jar:na]
Caused by: java.io.IOException: error=2, No such file or directory
at java.lang.UNIXProcess.forkAndExec(Native Method) ~[na:1.7.0_60]
at java.lang.UNIXProcess.(UNIXProcess.java:186) ~[na:1.7.0_60]
at java.lang.ProcessImpl.start(ProcessImpl.java:130) ~[na:1.7.0_60]
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1022) ~[na:1.7.0_60]
... 11 common frames omitted
127.0.0.1 - - - 06/Aug/2015:10:29:10 +0800 "POST /sessions HTTP/1.1" 500 90

does anyone know the problem??
my hue version is 3.8.1

thanks

@romainr
Copy link
Contributor

romainr commented Aug 6, 2015

Do you have Spark installed on the machine?

It says that it can't find the 'spark-submit' command that comes with Spark.

@romainr romainr closed this as completed Aug 27, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants