Skip to content

v0.2.1: Xarray-SQL Performance Improvements.

Choose a tag to compare

@alxmrs alxmrs released this 07 Mar 06:22
f1f6694

What's Changed

  • fix: perf_tests scripts to use pyarrow or LazyArrowStreamTable by @ljstrnadiii in #111
  • replace typing module with native collection types by @Ebraam-Ashraf in #120
  • Xarray-specific filter predicate pushdown. by @alxmrs in #113
  • Convert a Xarray Dataset partition to a pyarrow record batch directly (without going through pandas). by @alxmrs in #134
  • Iterating through block into multiple record batches per partition. by @alxmrs in #135
  • Iterate through metadata instead of materializing it all up front. by @alxmrs in #136
  • Improve concurrency by releasing the GIL between batches. by @alxmrs in #137
  • Column Projection Pushdown by @alxmrs in #119
  • Upgrade to DataFusion 52.0.0 by @alxmrs in #142
  • Increase cargo version (minor). by @alxmrs in #143

New Contributors

Full Changelog: v0.2.0...v0.2.1