[WIP][SPARK-29750][BUILD] Avoid dependency from joda-time

[MaxGekk]

What changes were proposed in this pull request?

Removed direct dependency from joda-time.

Why are the changes needed?

To reduce number of direct Spark dependencies.

Does this PR introduce any user-facing change?

No, only if users depend on joda-time transitively.

How was this patch tested?

By building Spark via ./build/sbt -Phive -Phive-thriftserver package

[SparkQA]

Test build #113242 has finished for PR 26392 at commit cb8c387.

• This patch fails build dependency tests.
• This patch merges cleanly.
• This patch adds no public classes.

[dongjoon-hyun]

Instead of this, joda-time-2.9.9.jar seems to occur transitively. Could you check the dependency tree and remove that, too?

+++ b/dev/pr-deps/spark-deps-hadoop-2.7
@@ -125,6 +125,7 @@ jetty-6.1.26.jar
 jetty-sslengine-6.1.26.jar
 jetty-util-6.1.26.jar
 jline-2.14.6.jar
+joda-time-2.9.9.jar
 jodd-core-3.5.2.jar
 jpam-1.1.jar
 json4s-ast_2.12-3.6.6.jar

[dongjoon-hyun]

Ur, are you suggesting to have two difference (lower) joda-time version in this commit??? ;)

[dongjoon-hyun]

Sorry, but I'm -1 to downgrade like this. If this PR is not aiming the removal of joda-time completely, let's not do this.

[MaxGekk]

Sorry, but I'm -1 to downgrade like this.

@dongjoon-hyun You are so quick.

[MaxGekk]

arrow vector requires joda time in 12.x:

[info] joda-time:joda-time:2.9.9
[info]   +-org.apache.arrow:arrow-vector:0.12.0

https://github.com/apache/arrow/blob/apache-arrow-0.12.0/java/vector/pom.xml#L34-L38
but arrow 0.15.1 does not require it anymore: https://github.com/apache/arrow/blob/apache-arrow-0.15.1/java/vector/pom.xml

[dongjoon-hyun]

Is that the last one? Or, just one dependency instance?

[MaxGekk]

Is that the last one? Or, just one dependency instance?

I bumped arrow version to 0.15.1 locally, so, there is no dependency from joda-time anymore. Not sure that is is safe to migrate to arrow vector 0.15.1

[dongjoon-hyun]

I pinged you the on-going Arrow upgrade PR. Let's resume this PR after that PR.

[MaxGekk]

There is a transitive dependency from joda-time via hive-common for hadoop-3.2:

[info] joda-time:joda-time:2.8.1
[info]   +-org.apache.hive:hive-common:2.3.6
[info]     +-org.apache.spark:spark-hive_2.12:3.0.0-SNAPSHOT [S]

which still exists in hive's master: https://github.com/apache/hive/blob/master/common/pom.xml#L101-L105

[SparkQA]

Test build #113243 has finished for PR 26392 at commit 02e9bee.

• This patch fails due to an unknown error code, -9.
• This patch merges cleanly.
• This patch adds no public classes.

[MaxGekk]

I am closing this because there is no chance of hive-common avoids dependency from joda-time any time soon.