v1.8.5

Milestone

• https://github.com/apache/orc/milestone/21

Changelog

• v1.8.4...v1.8.5

Bug

ORC-1315: [C++] Byte to integer conversions fail on platforms with unsigned char type
ORC-1482: RecordReaderImpl.evaluatePredicateProto assumes floating point stats are always present

Task:

ORC-1489 Assign a writer id to CUDF

v1.9.1

Milestone

• https://github.com/apache/orc/milestone/22

Changelog

• https://github.com/apache/orc/commits/v1.9.1

Bug

• ORC-1455 Fix build failure on non-x86 with unused macro in CpuInfoUtil.cc
• ORC-1457 Fix ambiguous overload of Type::createRowBatch
• ORC-1462 Bump aircompressor to 0.25 to fix JDK-8081450

Test

• ORC-1432 Add MacOS 13 GitHub Action Job
• ORC-1464 Bump avro to 1.11.2
• ORC-1465 Bump snappy-java to 1.1.10.3

v1.9.0

Milestone

• https://github.com/apache/orc/milestone/10

Changelog

• https://github.com/apache/orc/commits/v1.9.0

New Feature and Notable Changes

• ORC-961 Expose metrics of the reader
• ORC-1167 Support orc.row.batch.size configuration
• ORC-1252 Expose io metrics for write operation
• ORC-1301 Enforce C++17
• ORC-1310 allowlist Support for plugin filter
• ORC-1356 Use Intel AVX-512 instructions to accelerate the Rle-bit-packing decode
• ORC-1385 Support schema evolution from numeric to numeric
• ORC-1386 Support schema evolution from primitive to string group/decimal/timestamp

Improvement

• ORC-827 Utilize Array copyOf
• ORC-1170 Optimize the RowReader::seekToRow function
• ORC-1232 Disable metrics collector by default
• ORC-1278 Update Readme.md cmake to 3.12
• ORC-1279 Update cmake version
• ORC-1286 Replace DataBuffer with BlockBuffer in the BufferedOutputStream
• ORC-1298 Support dedicated ColumnVectorBatch of numeric types
• ORC-1302 Upgrade Github workflow to build on Windows
• ORC-1306 Fixed indented code style for Java modules
• ORC-1307 Add coding style enforcement
• ORC-1314 Remove macros defined before C++11
• ORC-1347 Use make_unique and make_shared when creating unique_ptr and shared_ptr
• ORC-1348 TimezoneImpl constructor should pass std::vector<> & instead of std::vector<>
• ORC-1349 Remove useless bufStream definition
• ORC-1352 Remove ORC_[NOEXCEPT|NULLPTR|OVERRIDE|UNIQUE_PTR] macro usages
• ORC-1355 Writer::addUserMetadata change parameter to reference
• ORC-1373 Add log when DynamicByteArray length overflow
• ORC-1401 Allow writing an intermediate footer
• ORC-1421 Use PyArrow 12.0.0 in document

Bug

• ORC-1225 Bump maven-assembly-plugin to 3.4.2
• ORC-1266 DecimalColumnVector resets the isRepeating flag in the nextVector method
• ORC-1273 Bump opencsv to 5.7.0
• ORC-1297 Bump opencsv to 5.7.1
• ORC-1304 throw ParseError when using SearchArgument with nested struct
• ORC-1315 Byte to integer conversions fail on platforms with unsigned char type
• ORC-1320 Fix build break of C++ code on docker images
• ORC-1363 Upgrade zookeeper to 3.8.1
• ORC-1368 Bump commons-csv to 1.10.0
• ORC-1398 Bump aircompressor to 0.24
• ORC-1399 Fix boolean type with useTightNumericVector enabled
• ORC-1433 Fix comment in the Vector.hh
• ORC-1447 Fix a bug in CpuInfoUtil.cc to support ARM platform
• ORC-1449 Add -Wno-unused-macros for Clang 14.0
• ORC-1450 Stop enforcing override keyword
• ORC-1453 Fix fall-through warning cases

Task

• ORC-1164 Setting version to 1.9.0-SNAPSHOT
• ORC-1218 Bump apache pom to 27
• ORC-1219 Remove redundant toString
• ORC-1237 Remove a wrong image link to article-footer.png
• ORC-1239 Upgrade maven-shade-plugin to 3.3.0
• ORC-1256 Publish test-jar to maven central
• ORC-1259 Bump slf4j to 2.0.0
• ORC-1269 Remove FindBugs
• ORC-1270 Move opencsv dependency to the tools module.
• ORC-1274 Add a checkstyle rule to ban starting LAND and LOR
• ORC-1275 Bump maven-jar-plugin to 3.3.0
• ORC-1276 Bump slf4j to 2.0.1
• ORC-1277 Bump maven-shade-plugin to 3.4.0
• ORC-1284 Add permissions to GitHub Action labeler
• ORC-1296 Bump reproducible-build-maven-plugin to 0.16
• ORC-1311 Bump maven-shade-plugin to 3.4.1
• ORC-1316 Bump slf4j.version to 2.0.4
• ORC-1334 Bump slf4j.version to 2.0.6
• ORC-1335 Bump netty-all to 4.1.86.Final
• ORC-1351 Update PR Labeler definition
• ORC-1358 Use spotless to format pom files
• ORC-1371 Remove unsupported SLF4J bindings from classpath
• ORC-1372 Bump zstd to v1.5.4
• ORC-1375 Cancel old running ci tasks when a pr has a new commit
• ORC-1377 Enforce override keyword
• ORC-1383 Upgrade aircompressor to 0.22
• ORC-1395 Enforce license check
• ORC-1396 Bump slf4j to 2.0.7
• ORC-1410 Bump zstd to v1.5.5
• ORC-1411 Remove Ubuntu18.04 from docker-based tests
• ORC-1419 Bump protobuf-java to 3.22.3
• ORC-1428 Setup GitHub Action CI on branch-1.9
• ORC-1443 Enforce Java version
• ORC-1444 Enforce JDK Bytecode version
• ORC-1446 Publish snapshot from branch-1.9

Test

• ORC-1231 Update supported OS list in building.md
• ORC-1233 Bump junit to 5.9.0
• ORC-1234 Upgrade objenesis to 3.2 in Spark benchmark
• ORC-1235 Bump avro to 1.11.1
• ORC-1240 Update site README to use apache/orc-dev
• ORC-1241 Use apache/orc-dev DockerHub repository in Docker tests
• ORC-1250 Bump mockito to 4.7.0
• ORC-1254 Add spotbugs check
• ORC-1258 Bump byte-buddy to 1.12.14
• ORC-1262 Bump maven-checkstyle-plugin to 3.2.0
• ORC-1265 Upgrade spotbugs to 4.7.2
• ORC-1267 Bump mockito to 4.8.0
• ORC-1271 Bump spotbugs-maven-plugin to 4.7.2.0
• ORC-1272 Bump byte-buddy to 1.12.16
• ORC-1300 Update Spark to 3.3.1 and its dependencies
• ORC-1303 Upgrade GoogleTest to 1.12.1
• ORC-1318 Upgrade mockito.version to 4.9.0
• ORC-1319 Upgrade byte-buddy to 1.12.19
• ORC-1321 Bump checkstyle to 10.5.0
• ORC-1322 Upgrade centos7 docker image to use gcc9
• ORC-1324 Use Java 19 instead of 18 in GHA
• ORC-1333 Bump mockito to 4.10.0
• ORC-1341 Bump mockito to 4.11.0
• ORC-1353 Bump byte-buddy to 1.12.21
• ORC-1359 Bump byte-buddy to 1.12.22
• ORC-1366 Bump checkstyle to 10.7.0
• ORC-1367 Bump maven-enforcer-plugin to 3.2.1
• ORC-1369 Bump byte-buddy to 1.12.23
• ORC-1370 Bump snappy-java to 1.1.9.1
• ORC-1374 Update Spark to 3.3.2
• ORC-1378 Add slf4j impl to avoid warning message in example module
• ORC-1379 Upgrade spotbugs to 4.7.3.2
• ORC-1380 Upgrade checkstyle to 10.8.0
• ORC-1394 Bump maven-assembly-plugin to 3.5.0
• ORC-1397 Bump checkstyle to 10.9.2
• ORC-1405 Bump spotbugs-maven-plugin to 4.7.3.4
• ORC-1406 Bump maven-enforcer-plugin to 3.3.0
• ORC-1408 Add testVectorBatchHasNull test case and comment
• ORC-1415 Add Java 20 to GitHub Action CI
• ORC-1417 Bump checkstyle to 10.10.0
• ORC-1418 Bump junit to 5.9.3
• ORC-1426 Use Java 21-ea instead of 20 in GitHub Action
• ORC-1435 Bump maven-checkstyle-plugin to 3.3.0
• ORC-1436 Bump snappy-java to 1.1.10.0
• ORC-1452 Use the latest OS versions in variant tests

v1.8.4

Milestone

• https://github.com/apache/orc/milestone/18

Changelog

• v1.8.3...v1.8.4

Bug

ORC-1304: [C++] Fix seeking over empty PRESENT stream
ORC-1400: Use Hadoop 3.3.5 on Java 17+ and benchmark
ORC-1413: Fix for ORC row level filter issue with ACID table

Test:

ORC-1404 Bump parquet to 1.13.0
ORC-1414 Upgrade java bench module to spark3.4
ORC-1416 Upgrade Jackson dependency to 2.14.2 in bench module
ORC-1420 Pin net.bytebuddy package to 1.12.x

Task:

ORC-1395 Enforce license check via github action

v1.7.9

Milestone

• https://github.com/apache/orc/milestone/17

Changelog

• v1.7.8...v1.7.9

Bug

• ORC-1382 Fix secondary config names org.sarg.* to orc.sarg.*
• ORC-1395 Enforce license check
• ORC-1407 Upgrade cyclonedx-maven-plugin to 2.7.6

Test

• ORC-1374 Update Spark to 3.3.2

v1.8.3

Milestone

• https://github.com/apache/orc/milestone/16

Changelog

• v1.8.2...v1.8.3

Bug

• ORC-1357 Handle missing compression block size
• ORC-1382 Fix secondary config names org.sarg.* to orc.sarg.*
• ORC-1384 Fix ArrayIndexOutOfBoundsException when reading dictionary stream bigger then dictionary
• ORC-1393 Add reset(DiskRangeList input, long length) to InStream impl class

Test

• ORC-1360 Pin mockito to 4.x
• ORC-1364 Pin spotless to 2.30.0
• ORC-1374 Update Spark to 3.3.2

Tasks

• ORC-1358 Use spotless to format pom files

v1.7.8

Milestone

• https://github.com/apache/orc/milestone/14

Changelog

• v1.7.7...v1.7.8

Bug

• ORC-1332 Avoid NegativeArraySizeException when using searchArgument
• ORC-1343 Disable ENABLE_INDEXES

Improvement

• ORC-1342 Publish SBOM artifacts
• ORC-1344 Skip SBOM generation during CMake
• ORC-1345 Use makeBom and skip snapshot check in GitHub Action publish_snapshot job

Test

• ORC-1323 Make docker/reinit.sh support target OS arguments

v1.8.2

Milestone

• https://github.com/apache/orc/milestone/15

Changelog

• v1.8.1...v1.8.2

Bug

• ORC-1332 Avoid NegativeArraySizeException when using searchArgument
• ORC-1343 Disable ENABLE_INDEXES

Improvement

• ORC-1327 Exclude the proto files from the nohive jar
• ORC-1328 Exclude the proto files from the shaded protobuf jar
• ORC-1329 Add OrcConf.getStringAsList method
• ORC-1338 Set bloom filter fpp to 1%
• ORC-1342 Publish SBOM artifacts
• ORC-1344 Skip SBOM generation during CMake
• ORC-1345 Use makeBom and skip snapshot check in GitHub Action publish_snapshot job

Test

• ORC-1323 Make docker/reinit.sh support target OS arguments
• ORC-1330 Add TestOrcConf
• ORC-1339 Remove orc.sarg.to.filter default value assumption in test cases
• ORC-1350 Upgrade setup-java to v3

Tasks

• ORC-1331 Improve PyArrow page
• ORC-1336 Protect .asf.yaml, api, ORC-Deep-Dive-2020.pptx files in website
• ORC-1337 Make .htaccess up to date
• MINOR Add .swp to .gitignore
• MINOR Link to Apache ORC orc_proto instead of Hive one
• MINOR Update DOAP file

v1.8.1

Milestone

• https://github.com/apache/orc/milestone/13

Changelog

• v1.8.0...v1.8.1

Bug

• ORC-1283 ENABLE_INDEXES does not take effect
• ORC-1288 Invalid memory freeing with ZLIB compression
• ORC-1291 NullPointerException in TypeDescription

Improvement

• ORC-1268 Set CMP0135 policy for CMake 3.24+
• ORC-1282 Add slf4j impl to avoid warning message
• ORC-1294 Build error when skip tests build
• ORC-1295 Improve ORC Spec example (Decoding RLE v2 direct)
• ORC-1299 benchmark can't work for data resource 403
• ORC-1305 Add more orc java examples
• ORC-1308 Avoid star import

Test

• ORC-1290 Bump spotbugs to 4.7.3
• ORC-1300 Update Spark to 3.3.1 and its dependencies

Tasks

• ORC-1269 Remove FindBugs
• ORC-1270 Move opencsv dependency to the tools module.
• ORC-1292 Add paragraph in java documentation

v1.7.7

Milestone

• https://github.com/apache/orc/milestone/12

Changelog

• v1.7.6...v1.7.7

Bug

• ORC-1283 ENABLE_INDEXES does not take effect

Test

• ORC-1254 Add spotbugs check
• ORC-1299 Fix fetch data error in bench module

Task

• ORC-1256 Publish tests jar to maven central
• ORC-1268 Set CMP0135 policy for CMake 3.24+