You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When we are using this library, in Spark job, we see the following conflict:
Caused by: java.lang.LinkageError: loader constraint violation in interface itable initialization: when resolving method "com.google.cloud.spark.bigquery.BigQueryUtilScala$.org$apache$spark$internal$Logging$$log_()Lorg/slf4j/Logger;" the class loader (instance of org/apache/spark/util/ChildFirstURLClassLoader) of the current class, com/google/cloud/spark/bigquery/BigQueryUtilScala$, and the class loader (instance of sun/misc/Launcher$AppClassLoader) for interface org/apache/spark/internal/Logging have different Class objects for the type org/slf4j/Logger used in the signature
We found that we have extra slf4j dependency in the bigquery connector dependency tree in Bigquery Connector version: 0.18.0. We tried to exclude slf4j dependency from arrow-vector, build it and try customized jar. And we didn't see error specified above.
We would like to exclude slf4j-api dependency from arrow-vector as follows:
When we are using this library, in Spark job, we see the following conflict:
We found that we have extra slf4j dependency in the bigquery connector dependency tree in Bigquery Connector version: 0.18.0. We tried to exclude slf4j dependency from
arrow-vector
, build it and try customized jar. And we didn't see error specified above.We would like to exclude
slf4j-api
dependency fromarrow-vector
as follows:in Line 82 in
build.sbt
file.The text was updated successfully, but these errors were encountered: