Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NoClassDefFoundError: org/apache/spark/Logging #25

Open
Yishun99 opened this issue Nov 26, 2016 · 2 comments
Open

NoClassDefFoundError: org/apache/spark/Logging #25

Yishun99 opened this issue Nov 26, 2016 · 2 comments

Comments

@Yishun99
Copy link

After packaging to .jar file, I add it to intelliJ IDEA as library. And I get this error.
"java.lang.NoClassDefFoundError: org/apache/spark/Logging", because of the "Logging" class is "private[spark]".

How could I use IndexedRDD in ide?

@linmingze
Copy link

java.lang.NoClassDefFoundError: com/ankurdave/part/ArtTree
My problem
when put something into indexedRdd

@luismilanooliveira
Copy link

luismilanooliveira commented Apr 5, 2017

Don't know about @DouYishun problem, but I was having the same issue as @linmingze. It probably is some problem with dependency resolution.
It's basically the same issue described in #8
The workaround I used was building the package myself through the sbt assembly command, so it included all the dependencies in the target .jar, which then I pass as argument when invoking spark-shell or spark-submit.

i.e. what I did was simply:

$ git clone https://github.com/amplab/spark-indexedrdd
$ cd spark-indexedrdd
$ sbt assembly
$ $SPARK_HOME/bin/spark-shell --jars target/scala-2.11/spark-indexedrdd-assembly-0.4.0.jar

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants