Skip to content

Commit 26a4cba

Browse files
dongjoon-hyunrxin
authored andcommitted
[SPARK-19409][BUILD] Bump parquet version to 1.8.2
## What changes were proposed in this pull request? According to the discussion on #16281 which tried to upgrade toward Apache Parquet 1.9.0, Apache Spark community prefer to upgrade to 1.8.2 instead of 1.9.0. Now, Apache Parquet 1.8.2 is released officially last week on 26 Jan. We can use 1.8.2 now. https://lists.apache.org/thread.html/af0c813f1419899289a336d96ec02b3bbeecaea23aa6ef69f435c142%3Cdev.parquet.apache.org%3E This PR only aims to bump Parquet version to 1.8.2. It didn't touch any other codes. ## How was this patch tested? Pass the existing tests and also manually by doing `./dev/test-dependencies.sh`. Author: Dongjoon Hyun <dongjoon@apache.org> Closes #16751 from dongjoon-hyun/SPARK-19409.
1 parent be7425e commit 26a4cba

File tree

6 files changed

+31
-31
lines changed

6 files changed

+31
-31
lines changed

dev/deps/spark-deps-hadoop-2.2

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -129,13 +129,13 @@ opencsv-2.3.jar
129129
oro-2.0.8.jar
130130
osgi-resource-locator-1.0.1.jar
131131
paranamer-2.6.jar
132-
parquet-column-1.8.1.jar
133-
parquet-common-1.8.1.jar
134-
parquet-encoding-1.8.1.jar
135-
parquet-format-2.3.0-incubating.jar
136-
parquet-hadoop-1.8.1.jar
132+
parquet-column-1.8.2.jar
133+
parquet-common-1.8.2.jar
134+
parquet-encoding-1.8.2.jar
135+
parquet-format-2.3.1.jar
136+
parquet-hadoop-1.8.2.jar
137137
parquet-hadoop-bundle-1.6.0.jar
138-
parquet-jackson-1.8.1.jar
138+
parquet-jackson-1.8.2.jar
139139
pmml-model-1.2.15.jar
140140
pmml-schema-1.2.15.jar
141141
protobuf-java-2.5.0.jar

dev/deps/spark-deps-hadoop-2.3

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -136,13 +136,13 @@ opencsv-2.3.jar
136136
oro-2.0.8.jar
137137
osgi-resource-locator-1.0.1.jar
138138
paranamer-2.6.jar
139-
parquet-column-1.8.1.jar
140-
parquet-common-1.8.1.jar
141-
parquet-encoding-1.8.1.jar
142-
parquet-format-2.3.0-incubating.jar
143-
parquet-hadoop-1.8.1.jar
139+
parquet-column-1.8.2.jar
140+
parquet-common-1.8.2.jar
141+
parquet-encoding-1.8.2.jar
142+
parquet-format-2.3.1.jar
143+
parquet-hadoop-1.8.2.jar
144144
parquet-hadoop-bundle-1.6.0.jar
145-
parquet-jackson-1.8.1.jar
145+
parquet-jackson-1.8.2.jar
146146
pmml-model-1.2.15.jar
147147
pmml-schema-1.2.15.jar
148148
protobuf-java-2.5.0.jar

dev/deps/spark-deps-hadoop-2.4

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -136,13 +136,13 @@ opencsv-2.3.jar
136136
oro-2.0.8.jar
137137
osgi-resource-locator-1.0.1.jar
138138
paranamer-2.6.jar
139-
parquet-column-1.8.1.jar
140-
parquet-common-1.8.1.jar
141-
parquet-encoding-1.8.1.jar
142-
parquet-format-2.3.0-incubating.jar
143-
parquet-hadoop-1.8.1.jar
139+
parquet-column-1.8.2.jar
140+
parquet-common-1.8.2.jar
141+
parquet-encoding-1.8.2.jar
142+
parquet-format-2.3.1.jar
143+
parquet-hadoop-1.8.2.jar
144144
parquet-hadoop-bundle-1.6.0.jar
145-
parquet-jackson-1.8.1.jar
145+
parquet-jackson-1.8.2.jar
146146
pmml-model-1.2.15.jar
147147
pmml-schema-1.2.15.jar
148148
protobuf-java-2.5.0.jar

dev/deps/spark-deps-hadoop-2.6

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -144,13 +144,13 @@ opencsv-2.3.jar
144144
oro-2.0.8.jar
145145
osgi-resource-locator-1.0.1.jar
146146
paranamer-2.6.jar
147-
parquet-column-1.8.1.jar
148-
parquet-common-1.8.1.jar
149-
parquet-encoding-1.8.1.jar
150-
parquet-format-2.3.0-incubating.jar
151-
parquet-hadoop-1.8.1.jar
147+
parquet-column-1.8.2.jar
148+
parquet-common-1.8.2.jar
149+
parquet-encoding-1.8.2.jar
150+
parquet-format-2.3.1.jar
151+
parquet-hadoop-1.8.2.jar
152152
parquet-hadoop-bundle-1.6.0.jar
153-
parquet-jackson-1.8.1.jar
153+
parquet-jackson-1.8.2.jar
154154
pmml-model-1.2.15.jar
155155
pmml-schema-1.2.15.jar
156156
protobuf-java-2.5.0.jar

dev/deps/spark-deps-hadoop-2.7

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -145,13 +145,13 @@ opencsv-2.3.jar
145145
oro-2.0.8.jar
146146
osgi-resource-locator-1.0.1.jar
147147
paranamer-2.6.jar
148-
parquet-column-1.8.1.jar
149-
parquet-common-1.8.1.jar
150-
parquet-encoding-1.8.1.jar
151-
parquet-format-2.3.0-incubating.jar
152-
parquet-hadoop-1.8.1.jar
148+
parquet-column-1.8.2.jar
149+
parquet-common-1.8.2.jar
150+
parquet-encoding-1.8.2.jar
151+
parquet-format-2.3.1.jar
152+
parquet-hadoop-1.8.2.jar
153153
parquet-hadoop-bundle-1.6.0.jar
154-
parquet-jackson-1.8.1.jar
154+
parquet-jackson-1.8.2.jar
155155
pmml-model-1.2.15.jar
156156
pmml-schema-1.2.15.jar
157157
protobuf-java-2.5.0.jar

pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -134,7 +134,7 @@
134134
<!-- Version used for internal directory structure -->
135135
<hive.version.short>1.2.1</hive.version.short>
136136
<derby.version>10.12.1.1</derby.version>
137-
<parquet.version>1.8.1</parquet.version>
137+
<parquet.version>1.8.2</parquet.version>
138138
<hive.parquet.version>1.6.0</hive.parquet.version>
139139
<jetty.version>9.2.16.v20160414</jetty.version>
140140
<javaxservlet.version>3.1.0</javaxservlet.version>

0 commit comments

Comments
 (0)