Skip to content

Releases: YimingQiao/datafusion-bloom

datafusion-bloom 0.2.0

Choose a tag to compare

@YimingQiao YimingQiao released this 22 Aug 14:14

DataFusion 55 support release.

  • Supports Apache DataFusion 55.x and Rust 1.94 or newer.
  • Preserves Bloom transfer semantics while migrating to the DataFusion 55 planner, statistics, pruning, and execution-plan APIs.
  • Keeps prepared and instant sampling, FullRows and experimental row-location handoffs, memory fallback, and native join execution.
  • Adds DataFusion 55 performance-regression coverage for JOB and TPC-H.

DataFusion 54 users should remain on the 0.1.x release line or the release/df54 branch.

DataFusion Bloom v0.1.1

Choose a tag to compare

@YimingQiao YimingQiao released this 22 Aug 10:49

Bloom 0.1.1 improves the transfer implementation while retaining DataFusion 54.1 compatibility.

Highlights:

  • adds pruning-aware Instant Parquet sampling over candidate row groups
  • parallelizes FullRows materialization and transfer membership construction
  • strengthens streaming memory reservation and fail-open fallback behavior
  • splits the transfer pipeline into focused sampling, handoff, propagation, and Parquet layout modules
  • adds performance regression CI and expanded correctness coverage

See the README for reproducible JOB and TPC-H benchmark instructions.

DataFusion Bloom v0.1.0

Choose a tag to compare

@YimingQiao YimingQiao released this 17 Aug 02:31

First public preview of Bloom for Apache DataFusion.

Highlights:

  • Adds Bloom transfer and materialization ahead of DataFusion native inner equi-joins.
  • Keeps FullRows as the default handoff and RowLocations as an experimental opt-in path.
  • Uses single-flight prepared samples with bounded session reuse.
  • Accounts retained handoffs, samples, and membership structures in DataFusion's memory pool.
  • Falls back to the untouched native plan when recoverable transfer work cannot be completed.
  • Includes reproducible JOB, CEB IMDB, STATS-CEB, and TPC-H benchmark tooling.

Compatibility: Apache DataFusion 54.x from 54.1.0, Rust 1.88 or newer. Licensed under MIT.