0.79.0

What's Changed

• Remove arrow usage from VarBin::compare, VarBinView::filter and BoolArray::from_iter by @robert3005 in #8695
• Add list_sum expression by @mhk197 in #8676
• cuda: build.rs add trigger by @mag1c1an1 in #8708
• vortex-file: Spawn tasks via runtime instead of directly via tokio by @brancz in #8711
• Add UnionVariants type and embed it in DType::Union by @connortsui20 in #8703
• Add golden-corpus determinism tests for the default compressor by @connortsui20 in #8697
• Ignore quick-xml rustsec since we cannot update it ourselves by @robert3005 in #8712
• Ignore one more quick-xml rustsec advisory by @robert3005 in #8716
• Remove stored Union Nullability by @connortsui20 in #8714
• Optimize dependencies using cargo-shear by @AdamGS in #8715
• Implement LIKE in vortex instead of falling back to arrow by @robert3005 in #8709
• Update actions/setup-java digest to 0f481fc by @renovate[bot] in #8729
• Update actions/setup-python digest to ece7cb0 by @renovate[bot] in #8730
• Update actions/stale digest to 1e223db by @renovate[bot] in #8731
• Benchmarks for fixed-width array filtering by @robert3005 in #8727
• Add docs on how to use Spark vortex datasource by @robert3005 in #8728
• Fix integer overflow in BitBufferMut::truncate and append_n by @ksj1230 in #8474
• Reduce Java and vortex-jni build sizes by @AdamGS in #8734
• Update dependency ray to v2.56.0 [SECURITY] by @renovate[bot] in #8732
• fix(layout/dict): probe with the configured compressor instead of a hardcoded default by @tomsanbear in #8406
• remove old c++ api by @myrrc in #8736
• Split arrow dependency from vortex-array by @robert3005 in #8717
• New C++ api docs by @myrrc in #8737
• vx_expression_clone, remove vx_file_write_array by @myrrc in #8735
• ST_Intersects pushdown: vortex.geo.intersects kernel, DuckDB lowering, spatial function overrides by @HarukiMoriarty in #8704
• Reject negative Union type IDs by @connortsui20 in #8738
• feat(vortex-geo): add native geoarrow.box bounding-box type by @HarukiMoriarty in #8746
• Fix flaky CodSpeed microbenchmarks by @connortsui20 in #8742
• Reorganize the compressor by @connortsui20 in #8745
• Update dependency setuptools to v83 [SECURITY] by @renovate[bot] in #8752
• New C++ API by @myrrc in #8741
• fix(onpair): pin OnPair dictionary-training seed for determinism by @claude[bot] in #8756
• Better error message for unsupported Arrow vector type in Spark reader by @jackylee-ch in #8759
• duckdb 1.5.4 by @myrrc in #8761
• forbid todo!/unimplemented! in vortex-duckdb by @myrrc in #8762
• fix(spark): warn that overwrite destructively deletes existing files by @jackylee-ch in #8767
• test(spark): characterize ArrowUtils Arrow-to-Spark type mapping by @jackylee-ch in #8770
• Support reporting statistics and currently written byte size from writers in jni by @robert3005 in #8726
• feat(vortex-geo): geometry Bbox zone-map statistic + distance-filter pruning by @HarukiMoriarty in #8646
• VortexArrowColumnVector supports conversion from all arrow types that Spark can support by @robert3005 in #8771
• feat(vortex-geo): prune ST_Intersects filters via the AABB zone statistics by @HarukiMoriarty in #8775
• fix(cuda): preserve dictionary value nulls by @0ax1 in #8774
• ci: cut wasted minutes from measurement_id and WASM jobs by @a10y in #8776
• ListArray::reset_offsets doesn't need to revalidate array after reset by @robert3005 in #8781
• New C++ API tests by @myrrc in #8751
• test(spark): characterize PartitionPathUtils partition discovery and materialization by @jackylee-ch in #8783
• Own SQL benchmark suite by @myrrc in #8719
• test(spark): characterize SparkToArrowSchema Spark-to-Arrow conversion by @jackylee-ch in #8782
• Expose CUDA-compatible file sink through FFI by @onursatici in #8784
• Expose pooled CUDA file scans through FFI by @onursatici in #8788
• feat(jni): bridge caller-provided Java I/O into VortexReadAt/VortexWrite by @robert3005 in #8748
• feat(cuda): export FSST directly to Arrow varbin by @0ax1 in #8787
• feat[buffer]: specialized collect_bool per arch by @joseph-isaacs in #8749
• feat: arch intrinsic feature discovery pattern by @joseph-isaacs in #8750
• Use u8 Union type IDs by @connortsui20 in #8790
• Add outer nullability to Union by @connortsui20 in #8798
• ListLayout baseline by @mhk197 in #8706
• Remove the old v2 benchmarks website by @connortsui20 in #8805
• apply alp patches in parallel in cuda by @onursatici in #8793

New Contributors

• @mag1c1an1 made their first contribution in #8708
• @ksj1230 made their first contribution in #8474
• @claude[bot] made their first contribution in #8756
• @jackylee-ch made their first contribution in #8759

Full Changelog: 0.78.0...0.79.0