0.71.0

Changes

⚠️ Breaks

• Switch python runtime to CurrentThreadRuntime (#7896) @robert3005

✨ Features

• pluggable registry for input/export arrow kernels (#7824) @a10y
• feat[fastlanes]: allow delta to support signed bases (#7923) @joseph-isaacs
• Updated Variant array and the new VariantGet expression (#7877) @AdamGS
• Add Arrow to Vortex conversion to C FFI (#7906) @robert3005
• Add statistic expression (#7854) @gatesn
• Add DType::Union variant carrying just Nullability (#7901) @connortsui20
• tracing logger for duckdb (#7892) @myrrc
• simplify projection expression for SELECT * in duckdb (#7885) @myrrc
• TurboQuant again! (#7829) @connortsui20
• feat: all_non_distinct aggregation make fuzzer faster (#7827) @joseph-isaacs
• Add a new AggregateFn for UncompressedSize (#7715) @AdamGS
• feat: iterative execution for SparseArray (#7711) @joseph-isaacs
• feat: check VortexReadAt::read_at results in the I/O driver (#7783) @danking
• feat[vortex-cuda]: GPU FSST decompression kernel (#7776) @asubiotto
• Make struct cast implementation pluggable (#7684) @robert3005
• [claude] feat(bench): emit v3 JSONL records and dual-write to bench server (#7780) @connortsui20

🚀 Performance

• perf[array]: add the SimplifyCache to optimize (#7948) @joseph-isaacs
• Mimic duckdb's post-filter cardinality estimates (#7895) @myrrc
• Use many connections on the benchmarks server (#7852) @connortsui20
• Faster Mask::from_slices (#7857) @gatesn
• Improve intersect_by_rank performance (#7744) @robert3005
• perf[array]: small vec for slots (#7825) @joseph-isaacs
• perf[array]: outline the array parts data from the DynArray (#7750) @joseph-isaacs
• Remove more scalar_at from sparse arrays (#7439) @gatesn

🐛 Bug Fixes

21 changes

• BufferMut::zeroed_aligned stores actually allocated length instead of passed length (#7979) @robert3005
• move getrandom backend override to config.toml (#7983) @onursatici
• fix[gpu]: retain device buffers for dyn dispatch kernel (#7980) @0ax1
• fix[gpu]: handle sliced BP arrays in CUDA (#7912) @0ax1
• duckdb: flatten runend arrays on export if requested (#7951) @myrrc
• Fix segfault when calling vx CLI from Python bindings (#7947) @joseph-isaacs
• register_splits to get both offset and relative row_range (#7913) @onursatici
• Fix IsSorted return dtype (#7914) @connortsui20
• fix[gpu]: CUDA sliced patch views with device patches (#7911) @0ax1
• Reorder agg kernel dispatch, and have Combined use inner accumulators (#7889) @gatesn
• Widen VarBinBuilder offets during FSST compress (#7853) @connortsui20
• fix[array]: get_item reduce + struct wrong nullability (#7887) @joseph-isaacs
• fix[bitpacked]: slice patches in execute method (not reduce). (#7839) @joseph-isaacs
• Stop ignoring tests (#7844) @robert3005
• Fix features of vortex-python (#7837) @robert3005
• fix[py]: remove mimalloc in library (#7826) @joseph-isaacs
• fix[sparse]: ensure cached patches are updated and use PatchesData (#7811) @joseph-isaacs
• fix(ffi): double-free in partition scan on error (#7817) @m7kss1
• fix: partition in filter should err (not panic). (#7816) @joseph-isaacs
• Fix logo on benchmarks website (#7779) @connortsui20
• fix: make ExtDType metadata deserialization total over byte input (#7782) @gatesn

🧰 Maintenance

74 changes

• Update Rust crate lance-encoding to v6 (#7974) @renovate[bot]
• Lock file maintenance (#7976) @renovate[bot]
• Update anthropics/claude-code-action digest to 51ea8ea (#7959) @renovate[bot]
• Update cloudflare/wrangler-action action to v4 (#7972) @renovate[bot]
• Lock file maintenance (#7975) @renovate[bot]
• Update EmbarkStudios/cargo-deny-action digest to 6c8f9fa (#7960) @renovate[bot]
• Update taiki-e/install-action digest to 7be9fd8 (#7961) @renovate[bot]
• Update all patch updates (#7962) @renovate[bot]
• Update dependency lucide-react to v1.16.0 (#7967) @renovate[bot]
• Update arrow-rs (#7965) @renovate[bot]
• Update storybook monorepo to v10.4.0 (#7970) @renovate[bot]
• Update Rust crate dashmap to v6.2.1 (#7969) @renovate[bot]
• Update plugin com.diffplug.spotless to v8.5.1 (#7968) @renovate[bot]
• Update dependency eslint to v10.4.0 (#7966) @renovate[bot]
• Update slf4j monorepo to v2.0.18 (#7964) @renovate[bot]
• Update dependency typescript-eslint to v8.59.3 (#7963) @renovate[bot]
• Clippy deny absolute_paths longer than 3 elements (#7950) @robert3005
• Add stats rewrite session API (#7930) @gatesn
• Add a nicer progress bar and file-based filter (#7942) @AdamGS
• Use async_fs file for java and python writes to avoid object_store buffering on local disks (#7920) @robert3005
• Add NullCount aggregate function (#7933) @gatesn
• Centralize aggregate stat bridge (#7931) @gatesn
• Remove chunked special case from stat execution (#7928) @gatesn
• Remove needless fmt_sql (#7409) @gatesn
• Add more benchmarks for take on filter array (#7876) @robert3005
• use nonnull in lifetime_wrapper (#7908) @myrrc
• Pin nightly toolchain version in public-api (#7909) @robert3005
• Update flatbuffers generated (#7899) @connortsui20
• Add Executor::spawn_io (#7894) @AdamGS
• Update dependency urllib3 to v2.7.0 [SECURITY] (#7888) @renovate[bot]
• Remove unused protobuf dependency in java bindings (#7886) @robert3005
• bench: dyn dispatch / standalone perf comparsion (#7883) @0ax1
• Update all patch updates (#7862) @renovate[bot]
• Lock file maintenance (#7863) @renovate[bot]
• Pin actions/checkout action to de0fac2 (#7858) @renovate[bot]
• Update anthropics/claude-code-action digest to 476e359 (#7859) @renovate[bot]
• Update Rust crate noodles-vcf to 0.88.0 (#7870) @renovate[bot]
• Update aws-actions/configure-aws-credentials digest to d979d5b (#7860) @renovate[bot]
• Update taiki-e/install-action digest to fa0dd4c - autoclosed (#7861) @renovate[bot]
• Lock file maintenance (#7864) @renovate[bot]
• Update dependency io.netty:netty-bom to v4.2.13.Final (#7865) @renovate[bot]
• Update Rust crate noodles-bgzf to 0.47.0 (#7869) @renovate[bot]
• Update opentelemetry-rust monorepo to 0.32.0 (#7867) @renovate[bot]
• Update tailwindcss monorepo to v4.3.0 (#7872) @renovate[bot]
• Update release-drafter/release-drafter action to v7.3.0 (#7868) @renovate[bot]
• Update react monorepo to v19.2.6 (#7866) @renovate[bot]
• Collect slots directly into smallvec instead of using vec and into (#7847) @robert3005
• bench[gpu]: CUDA device memory pool benchmarks (#7831) @0ax1
• Use smallvec for internal stats storage (#7823) @robert3005
• bench[gpu]: overlap of compute and copying (#7828) @0ax1
• bench: CUDA host-to-device copy modes (#7815) @0ax1
• use rstest for some test cleanups (#7813) @a10y
• Update dependency pip to v26.1 [SECURITY] (#7805) @renovate[bot]
• Run vortex-mask benchmarks with codspeed (#7804) @robert3005
• Add more benchmarks for intersect by rank (#7800) @robert3005
• bench: CUDA sync load-to-device benchmark (#7799) @0ax1
• Add Patches lookup benchmarks (#7795) @palaska
• Allow Claude to open PRs (#7798) @gatesn
• Fix weird signature of with_slots functions (#7758) @robert3005
• Update anthropics/claude-code-action digest to 2cc1ac1 (#7761) @renovate[bot]
• Update taiki-e/install-action digest to 711e1c3 (#7762) @renovate[bot]
• Update release-drafter/release-drafter action to v7.2.1 (#7763) @renovate[bot]
• Update storybook monorepo to v10.3.6 (#7765) @renovate[bot]
• Update crate-ci/typos action to v1.46.0 (#7766) @renovate[bot]
• Update dependency eslint to v10.3.0 (#7767) @renovate[bot]
• Update dependency globals to v17.6.0 (#7768) @renovate[bot]
• Update Gradle to v9.5.0 (#7770) @renovate[bot]
• Lock file maintenance (#7772) @renovate[bot]
• Lock file maintenance (#7771) @renovate[bot]
• Update dependency typescript-eslint to v8.59.2 (#7764) @renovate[bot]
• Update dependency lucide-react to v1.14.0 (#7769) @renovate[bot]
• Allow bot approvals (#7774) @gatesn
• Fix Claude workflow cancellation (#7775) @gatesn
• chore: codspeed display names (#7752) @0ax1