From c1321c01eeea62214019aa4bc3ca70ba9b388b9b Mon Sep 17 00:00:00 2001 From: Dongjoon Hyun Date: Wed, 14 Feb 2024 10:02:21 -0800 Subject: [PATCH] [SPARK-47038][BUILD] Remove shaded `protobuf-java` 2.6.1 dependency from `kinesis-asl-assembly` ### What changes were proposed in this pull request? This PR aims to remove the shaded `protobuf-java` 2.6.1 dependency from `kinesis-asl-assembly`. ### Why are the changes needed? Technically, this is a revert of SPARK-14421. - At that time, Apache Spark 2.0.0 distribution contains `protobuf-java-2.5.0.jar`. - #13054 - SPARK-43489 removed `protobuf-java-2.5.0.jar` from Apache Spark 3.5+ distribution. - #41153 ### Does this PR introduce _any_ user-facing change? No, but the user can inject the required protobuf-jar from application layers. ### How was this patch tested? Pass the CIs and manual review. **BEFORE** ``` $ build/mvn dependency:tree -pl connector/kinesis-asl-assembly -Pkinesis-asl | grep protobuf-java ... [INFO] +- com.google.protobuf:protobuf-java:jar:2.6.1:provided ``` **AFTER** ``` $ build/mvn dependency:tree -pl connector/kinesis-asl-assembly -Pkinesis-asl | grep protobuf-java ... [INFO] | | +- com.google.protobuf:protobuf-java:jar:3.25.1:provided ``` ### Was this patch authored or co-authored using generative AI tooling? No. Closes #45096 from dongjoon-hyun/SPARK-47038. Authored-by: Dongjoon Hyun Signed-off-by: Dongjoon Hyun --- connector/kinesis-asl-assembly/pom.xml | 19 ------------------- 1 file changed, 19 deletions(-) diff --git a/connector/kinesis-asl-assembly/pom.xml b/connector/kinesis-asl-assembly/pom.xml index ecd7d13dcba94..577ec21530837 100644 --- a/connector/kinesis-asl-assembly/pom.xml +++ b/connector/kinesis-asl-assembly/pom.xml @@ -59,16 +59,6 @@ commons-lang provided - - com.google.protobuf - protobuf-java - 2.6.1 - - org.glassfish.jersey.core jersey-client @@ -173,15 +163,6 @@ *:* - - - com.google.protobuf - kinesis.protobuf - - com.google.protobuf.** - - - *:*