ParquetSharp 20.0.0
This version of ParquetSharp upgrades the underlying Arrow C++ Parquet library to version 20.0.0. ParquetSharp also now builds Arrow with support for the mimalloc and jemalloc native memory allocators, and will use mimalloc by default. You can switch back to the old system allocator by setting the ARROW_DEFAULT_MEMORY_POOL environment variable to system.
Note that if writing large Parquet files that use array typed columns, there is a known bug that can cause page sizes to grow large. This can be worked around by disabling page index writing.
What's Changed
- Support writing custom types that can represent nulls by @adamreeve in #526
- Support writing required byte arrays by @adamreeve in #531
- Upgrade Arrow C++ to 20.0.0 by @adamreeve in #528
- Don't require passing a logical type override for Guid typed columns by @adamreeve in #535
- Use ArrayPool for Reader and Writer Buffers by @johnthcall in #537
- Build Arrow with support for mimalloc and jemalloc by @adamreeve in #540
Full Changelog: 19.0.1...20.0.0