arrow 54.3.0

Changelog

54.3.0 (2025-03-17)

Full Changelog

Implemented enhancements:

• Using column chunk offset index in InMemoryRowGroup::fetch #7300
• Support reading parquet with modular encryption #7296 [parquet]
• Add example for how to read/write encrypted parquet files #7281 [parquet]
• Have writer return parsed ParquetMetadata #7254 [parquet]
• feat: Support Utf8View in JSON reader #7244 [arrow]
• StructBuilder should provide a way to get a &dyn ArrayBuilder of a field builder #7193 [arrow]
• Support div_wrapping/rem_wrapping for numeric arithmetic kernels #7158 [arrow]
• Improve RleDecoder performance #7195 [parquet] (Dandandan)
• Improve arrow-json deserialization performance by 30% #7157 [arrow] (mwylde)
• Add with_skip_validation flag to IPC StreamReader, FileReader and FileDecoder #7120 [arrow] (alamb)

Fixed bugs:

• Archery integration CI test is failing on main: error: package half v2.5.0 cannot be built because it requires rustc 1.81 or newer, while the currently active rustc version is 1.77.2 #7291
• MSRV CI check is failing on main #7289
• Incorrect IPC schema encoding for multiple dictionaries #7058 [arrow] [arrow-flight]

Documentation updates:

• Add example for how to read encrypted parquet files #7283 [parquet] (rok)
• Update the relative path of the test data in docs #7221 (Ziy1-Tan)
• Minor: fix doc and remove unused code #7194 [arrow] (lewiszlw)
• doc: modify wrong comment #7190 [arrow] (YichiZhang0613)
• doc: fix IPC file reader/writer docs #7178 [arrow] (Jefffrey)

Merged pull requests:

• chore: require ffi feature in arrow-schema benchmark #7298 [arrow] (ethe)
• Fix archery integration test #7292 (alamb)
• Minor: run test_decimal_list again #7282 [parquet] (alamb)
• Move Parquet encryption tests into the arrow_reader integration tests #7279 [parquet] (adamreeve)
• Include license and notice files in published crates, part 2 #7275 [arrow] (ankane)
• feat: Support Utf8View in JSON reader #7263 [arrow] (zhuqi-lucas)
• feat: use force_validate feature flag when creating an arrays #7241 [arrow] (rluvaton)
• fix: take on empty struct array returns empty array #7224 [arrow] (westonpace)
• fix: correct bloom_filter_position description #7223 [parquet] (romanz)
• Minor: Move make_builder into mod.rs #7218 (lewiszlw)
• Expose field_builders in StructBuilder #7217 [arrow] (lewiszlw)
• Minor: Fix json StructMode docs links #7215 [arrow] (gstvg)
• [main] Bump arrow version to 54.2.1 (#7207) #7212 (alamb)
• feat: add downcast_integer_array macro helper #7211 [arrow] (rluvaton)
• Remove zstd pin #7199 [parquet] (tustvold)
• fix: Use chrono's quarter() to avoid conflict #7198 [arrow] (yutannihilation)
• Fix some Clippy 1.85 warnings #7167 [parquet] [arrow] (mbrobbel)
• feat: add to concat different data types error message the data types #7166 [arrow] (rluvaton)
• Add Week ISO, Year ISO computation #7163 [arrow] (kosiew)
• fix: create_random_batch fails with timestamp types having a timezone #7162 [arrow] (niebayes)
• Avoid overflow of remainder #7159 [arrow] (wForget)
• fix: Data type inference for NaN, inf and -inf in csv files #7150 [arrow] (Mottl)
• Preserve null dictionary values in interleave and concat kernels #7144 [arrow] (kawadakk)
• Support casting Date to a time zone-specific timestamp #7141 [arrow] (friendlymatthew)
• Minor: Add doctest to ArrayDataBuilder::build_unchecked #7139 [arrow] (gstvg)
• arrow-ord: add support for nested types to partition #7131 [arrow] (asubiotto)
• Update prost-build requirement from =0.13.4 to =0.13.5 #7127 [arrow] [arrow-flight] (dependabot[bot])
• Avoid use of flatbuffers::size_prefixed_root, fix validation error in arrow-flight #7109 [arrow] [arrow-flight] (bkietz)
• Optimise decimal casting for infallible conversions #7021 [arrow] (aweltsch)

53.4.1 (2025-03-04)

Full Changelog

Fixed bugs:

• Take empty struct array would get array with length 0 #7225

Closed issues:

• Release arrow-rs / parquet patch version 54.2.1 (Feb 2025) (HOTFIX) #7209 [arrow]

* This Changelog was automatically generated by github_changelog_generator