v0.30.1-beta.1

What's Changed

New Features 🎉

• feat: add column projection to LanceFileReader by @wojiaodoubao in #4031
• feat: add consecutive batch shard sampler for pytorch by @Jay-ju in #3886
• feat: add Trino and PostgreSQL integrations by @jackye1995 in #4054
• feat: expose num_rows api for python LanceFileReader by @yanghua in #4053
• feat: add IVF_HNSW_FLAT index by @BubbleCal in #3671
• feat: introduce IndexFileVersion for Python API by @BubbleCal in #4040
• feat: add created_at for indices by @wjones127 in #4051
• feat: support large_string/large_binary in lance format v2.1 by @HaochengLIU in #3967
• feat: upgrade arrow object_store to 0.12.2 by @jackye1995 in #4080

Bug Fixes 🐛

• fix: can't search on a *_SQ index with f64 vectors by @BubbleCal in #3672
• fix: torchdataset for lance does not support S3 by @Jay-ju in #4045
• fix: incorrect parameter order when initializing ShardedFixedBatchSam… by @ddupg in #4064
• fix: take benchmark can not read dataset by @yanghua in #4065
• fix: escape type keyword in tracing::info! macros by @bjurkovski in #4068
• fix: better errors on bad filters by @westonpace in #4073
• fix(doc): fix doc typo in Ray integration documentation for Lance Data Sink by @kilavvy in #3984
• fix: don't check vector indices when loading scalar index by @BubbleCal in #4077

Documentation 📚

• docs: fix write_dataset append mode obsolete description by @wojiaodoubao in #3866

Performance Improvements 🚀

• perf: fast upsert with no indices by @wjones127 in #3858

Other Changes

• refactor: don't use schema dictionary unless using legacy storage by @westonpace in #4023
• refactor: move 2.0 code into its own module by @westonpace in #4046

New Contributors

• @wojiaodoubao made their first contribution in #4031
• @ddupg made their first contribution in #4064
• @bjurkovski made their first contribution in #4068
• @kilavvy made their first contribution in #3984

Full Changelog: v0.30.0...v0.30.1-beta.1