Skip to content

rename hudi-spark-client jar to include the scala binary version #16628

@hudi-bot

Description

@hudi-bot

https://mvnrepository.com/artifact/org.apache.hudi/hudi-spark-client/1.0.0-beta2

hudi-spark-client depends on scala-collections-compat and Apache Spark jars that are built for Scala 2.12.

Ideally, to follow Scala jar naming norms, you should have hudi-spark-client_2.12.jar for Scala 2.12 users and hudi-spark-client_2.13.jar for Scala 2.13 users.

You already add the Scala version suffix to some other Hudi jars.

This is another one that looks like it should have a _2.12 suffix in the name.
https://mvnrepository.com/artifact/org.apache.hudi/hudi-spark3-common/1.0.0-beta2

If you look at hudi-spark3.5.x_2.13, it has a dependency on hudi-spark-client and it has Scala 2.12 dependencies. This is likely to cause a real complications for users.

https://repo1.maven.org/maven2/org/apache/hudi/hudi-spark3.5.x_2.13/1.0.0-beta2/hudi-spark3.5.x_2.13-1.0.0-beta2.pom

JIRA info

Metadata

Metadata

Assignees

Labels

from-jirapriority:highSignificant impact; potential bugstype:devtaskDevelopment tasks and maintenance work

Type

No type
No fields configured for issues without a type.

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions