New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
OLAP with Cassandra 3 input fails with Guava error #1159
Comments
@pluradj can you close out this issue? So I tried connecting to Spark cluster (2.2.0 standalone) using Janusgraph 3.0. It works now. I only needed to add "spark.executor.extraClassPath" as property the way I needed to add that to Janusgraph0.2.1. And once connection were done, I was able to run OLAP queries on them. |
Let's use this issue to update the documentation @debasishdebs |
@debasishdebs , can you share you spark-submit param details? I was not able to reproduce your result on SparkCluster 2.3.1 using Janusgraph 3.0. |
@debasishdebs , any ideas? really need your detailed settings to find out how it worked. |
@hxcoder65 : Few points from your comments, why are you using Spark 2.3.1 when JanusGraph 0.3.0 supports Spark 2.2.0? I don't use any spark-submit, rather used Gremlin Console to execute OLAP queries. I don't have access to the VMs where I've the env setup (Spark 2.2.0 cluster, Cassandra Cluster, ES Cluster, JG Client) so I can't verify the same now, but as far as I remembered, can you try migrating to Spark 2.2.0 and follow the docs released with JanusGraph 0.3.0 to the point, and if that still doesn't work, can you share stacktrace why that is happening? The docs are here! |
@hxcoder65 : Any success with your task? |
Yes, actually I resolved it by repackaging the a conflict package. I'll
join the JanusGraph users list.
…On Fri, Oct 12, 2018 at 2:54 AM Debasish Kanhar ***@***.***> wrote:
@hxcoder65 <https://github.com/hxcoder65> : Any success with your task?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#1159 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/Ap8e91xBcbww-2okdJYjvmth6-7XoCt3ks5ukGbMgaJpZM4VIBsy>
.
|
This was mentioned on janusgraph-users.
The scenario is running a SparkGraphComputer job on the master branch (0.3.0-SNAPSHOT) against Spark 2.2.0 cluster using the
conf/hadoop-graph/read-cassandra-3.properties
.The error most readily seen from the Gremlin Console is:
The
NoClassDefFoundError
seems to indicate that a jar file is missing, but it is misleading because looking more closely at the nested exceptions in the Spark worker:Trying to run with the other Cassandra input format:
Leads to this exception:
JanusGraph is packaging Guava 18.0, but Spark 2.2.0 has Guava 14.0.1. It seems that the Spark worker is picking up the wrong Guava.
The text was updated successfully, but these errors were encountered: