This repository has been archived by the owner on Mar 26, 2020. It is now read-only.
Can't create Hadoop Path instance #56
Labels
Comments
I narrowed the problem... to Creating a project with:
libraryDependencies ++= Seq(
"org.apache.hadoop" % "hadoop-common" % "2.6.0",
scalaOrganization.value % "scala-reflect" % scalaVersion.value
)
scalaVersion := "2.11.8"
import org.apache.hadoop.fs._
import scala.reflect.runtime.universe.weakTypeOf
object Test extends App {
println(weakTypeOf[Path])
}
Then running
So the problem seems not specific to ammonium. As a workaround though, some safeguards could be added around the |
Hi Alexandre, I see what you mean. Given that this problem is rooted in the Scala reflection library, it seems unlikely to be fixed anytime soon. Is the workaround you mentioned something you intend on implementing? I'm not sure exactly what you have in mind, but I could work on a PR if you're interested. Thanks, Michael |
try using this in your build.sbt: "org.apache.hadoop" % "hadoop-common" % "2.6.0" exclude("org.apache.hadoop", "hadoop-annotations") |
This seems ok from ammonite-spark. |
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
That darn
InterfaceAudience
type is always making trouble...I think this transcript says it all:
The text was updated successfully, but these errors were encountered: