Skip to content

v0.4.2 Polars, GCS, and distributed lances

Choose a tag to compare

@changhiskhan changhiskhan released this 14 Apr 17:57
· 4799 commits to main since this release

A warm welcome to @hzhang86 as Lance's newest contributor. Thanks for adding TPCH benchmarks for Lance to establish a baseline. This is really helpful for us to focus performance optimization roadmap.

This release is packed with valuable features:

  1. Direct polars scan without needing to pull everything into memory is added.
  2. We expose FileFragment's to allow distributed processing engines like Spark to access parts of a Lance dataset easily
  3. Last but not least, we've added support for reading Lance data directly from GS buckets

What's Changed

New Contributors

Full Changelog: v0.4.1...v0.4.2