Skip to content
This repository has been archived by the owner on Dec 15, 2023. It is now read-only.

NoClassDefFoundError RxDocumentClientImpl Running on databricks cluster #8

Open
rahuly-fragma opened this issue Jun 8, 2020 · 0 comments

Comments

@rahuly-fragma
Copy link

stacktrace :
Caused by: java.lang.NoClassDefFoundError: Could not initialize class com.microsoft.azure.cosmosdb.rx.internal.RxDocumentClientImpl
at com.microsoft.azure.cosmosdb.rx.AsyncDocumentClient$Builder.build(AsyncDocumentClient.java:196)
at com.bfl.datalakeToCosmosIngestion.CosmosConn.(CosmosConn.scala:11)
at com.bfl.datalakeToCosmosIngestion.CosmosOperations$$anonfun$startDemographicsCosmosLoad$1.apply(CosmosOperations.scala:30)
at com.bfl.datalakeToCosmosIngestion.CosmosOperations$$anonfun$startDemographicsCosmosLoad$1.apply(CosmosOperations.scala:28)
at org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$28.apply(RDD.scala:951)
at org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$28.apply(RDD.scala:951)
at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2284)
at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2284)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.doRunTask(Task.scala:139)
at org.apache.spark.scheduler.Task.run(Task.scala:112)
at org.apache.spark.executor.Executor$TaskRunner$$anonfun$13.apply(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1526)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:503)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
OS and Version : Running jar on Databricks Cluster
Versions:

com.microsoft.azure
azure-cosmosdb
2.2.0

Other Details :
1.Running in local i was getting belwo issue
java.lang.NoSuchFieldError: ALLOW_TRAILING_COMMA
2.To resolve this i have overwritten jackson-databind therefore issue got resolve
3.Its working in local.
4.But when i run the jar on databricks cluster than it gives exception that i have mentioned above.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant