This repository has been archived by the owner on Feb 18, 2024. It is now read-only.
v0.12.0
A new version of arrow2 is now available in crates.io. 馃帀馃帀馃帀
See below all great things that were released 馃殌. But before that, thank you so much to everyone that contributed to this release: 馃檱
@ahmedriza, @dexterduck, @GPSnoopy, @HaoYang670, @SimonSchneider, @TurnOfACard, @aptr322, @arxra, @b41sh, @cjermain, @dbr, @jorgecarleitao, @ritchie46
Breaking changes:
- Require one encoding per parquet column on write #1012
- Bumped parquet2 #1035 (jorgecarleitao)
- Improved performance of deserializing JSON (2x) #1024 (jorgecarleitao)
- Remove
from_trusted_len_*
fromBuffer
#1020 (jorgecarleitao) - Bumped arrow-format #1011 (jorgecarleitao)
- Replace
fn Offset::is_large()
asconst Offset::IS_LARGE
#1002 (HaoYang670) - Renamed
ArrowError
toError
#993 (jorgecarleitao)
New features:
- Added support to deserialize
MapArray
from parquet #1045 (jorgecarleitao) - Added support for random access reads from IPC #1034 (jorgecarleitao)
- Added support for custom sort
build_compare_fn
#1016 (b41sh) - Added support to write nested parquet #1007 (jorgecarleitao)
- Added support for deserializing JSON from iterator #989 (cjermain)
Fixed bugs:
- Writing of
ListArray
does not preserve all values #1008 - Write a two-dimensional list to parquet file failed #992
- Writing to Parquet fails for extension types that contain lists #830
- Fixed using lower limit than size of first parquet row group #1046 (arxra)
- Fixed error in consuming sliced
FixedSizedBinary
from c data interface (FFI) #1026 (jorgecarleitao) - Fixed lexsort limit equal or greater than row_count #1021 (b41sh)
- Fixed error in reading nested parquet structs #1015 (jorgecarleitao)
- Fixed panic on debug print of invalid timezones #1013 (jorgecarleitao)
- Treat empty timezone string as no-timezone #1009 (dbr)
- Fixed encoding of
NaN
to json #990 (SimonSchneider) - Fixed error in writing
ListArray
to parquet #984 (jorgecarleitao) - Fixed decoding Binary Plain pages with dictionary pages #982 (aptr322)
Enhancements:
- Added
Debug
andPartialEq
forMapArray
#1043 (jorgecarleitao) - Exposed compression levels for parquet #1041 (ritchie46)
- Added
.arced
/.boxed
to arrays #1040 (jorgecarleitao) - Added utility to create encodings #1018 (jorgecarleitao)
- Made
parquet_to_arrow_schema
public #1006 (martingallagher) - Speeded up
min_max_boolean
for the case where all values are null #1005 (HaoYang670) - Simplified
min_max_string
andmin_max_binary
#1004 (HaoYang670) - Added support for Decimal in
build_compare
#998 (GPSnoopy) - remove accidental quadratic null_count #991 (ritchie46)
- Aligns MutableDictionaryArray's with MutablePrimitiveArrays with TryPush #981 (TurnOfACard)
Documentation updates:
- Cleaned docs for BinaryArray #1047 (jorgecarleitao)
- Improved API docs for
MutableBitmap
#1025 (jorgecarleitao) - Improved docs for
bitmap
#1022 (jorgecarleitao) - Improved API docs for
PrimitiveArray
andUtf8Array
#1017 (jorgecarleitao) - Fixed dev guide #1003 (jorgecarleitao)
Testing updates:
- Added more tests #1029 (jorgecarleitao)
- Moved coverage reporting to
cargo-llvm-cov
#1028 (jorgecarleitao) - Added more tests (increase coverage) #1027 (jorgecarleitao)
- Moved tests from lib to
tests
#1001 (jorgecarleitao) - Allowed feature-specific test runs #985 (jorgecarleitao)