v0.7.11
·
112 commits
to refs/heads/main
since this release
What's Changed 🚀
✨ Features
- feat: Arrow PyCapsule Interface @aaron-ang (#6745)
- feat: add Python UDAF support (@daft.udaf) @chenghuichen (#6790)
- feat(dashboard): per-task rows/bytes stats with task-topology markers @samstokes (#6861)
- feat(iceberg): idempotent commits via daft.idempotence-key snapshot marker @rohitkulshreshtha (#6905)
- feat(lance): partitioned reads/writes @universalmind303 (#6898)
- feat(dashboard): make header smaller in query details @cckellogg (#6900)
- feat: streaming ASOF joins @euanlimzx (#6846)
- feat: Add map_keys function to extract keys from Map type columns @qingfeng-occ (#6875)
- feat: add event log config api @cckellogg (#6894)
- feat(dashboard): surface query failure details in query view @cckellogg (#6897)
- feat(dashboard): bound query state retention (DF-1970) @samstokes (#6896)
- feat(dashboard): per-task progress updates from flotilla workers @samstokes (#6838)
- feat(dashboard): plumb TaskScheduled events to distinguish pending vs running @samstokes (#6866)
- feat(dashboard): show task sources in tasks sidebar @samstokes (#6879)
- feat(ci): use larger runner for pr testing @cckellogg (#6890)
- feat(native): emit TaskStart events from native executor @cckellogg (#6840)
- feat(session): add non-materialized DataFrame temp views @BABTUNA (#6786)
- feat(dtype): add Float16 (half-precision) support @universalmind303 (#6859)
- feat: extension datatype casting @universalmind303 (#6803)
- feat(file): add Image media type to File @chenghuichen (#6847)
- feat(iceberg): idempotent snapshot commits via snapshot_properties @rohitkulshreshtha (#6841)
- feat(daft-ext): scalar daft_func macro with overloading @universalmind303 (#6844)
- feat(checkpoint): wire checkpoint= into csv, json, warc, iceberg, hudi, lance @rohitkulshreshtha (#6855)
- feat(checkpoint): bundle source config into CheckpointConfig with tunable filter knobs @rohitkulshreshtha (#6853)
- feat(checkpoint): decouple sealed-keys column name from source schema @rohitkulshreshtha (#6850)
- feat: use scan task metadata to parallelize initial limit reads @samstokes (#6763)
- feat(checkpoint): track in-flight writes and seal empty manifests @rohitkulshreshtha (#6835)
- feat(file): add byte-range read support to FileReference @chenghuichen (#6842)
- feat(list): add list_flatten expression @mytsvy (#6812)
- feat(extensions): add proc macro for making writing extension functio… @universalmind303 (#6837)
🐛 Bug Fixes
- fix: Handle dtype mismatch error in join_asof join keys @euanlimzx (#6904)
- fix(distributed): emit empty downstream task for limit(0) @madvart (#6916)
- fix(sql): redact password in SQL connection errors and repr @madvart (#6902)
- fix(dashboard): split task groups by local-plan shape @samstokes (#6899)
- fix(stats): close race in RuntimeStatsManager shutdown @samstokes (#6891)
- fix(writers): strip partition columns from Hive-partitioned file bodies @aaron-ang (#6770)
- fix(distributed): fire OperatorStart/End events per-node on Flotilla @samstokes (#6860)
- fix(test): handle transient iceberg rest catalog startup failures @cckellogg (#6880)
- fix(dashboard): handle offline builds in frontend @samstokes (#6867)
- fix: infer audio file return dtype @everettVT (#6849)
🚀 Performance
- perf(file): add buffer_size to File.open() to reduce wasteful pre-reads @chenghuichen (#6876)
- perf: iceberg predicate pushdowns @rchowell (#6815)
♻️ Refactor
- refactor(distributed): decouple shuffle cleanup from Ray @chenghuichen (#6809)
- refactor(dashboard): remove result preview tab and ResultOut event @samstokes (#6878)
📖 Documentation
- docs(dashboard): add user guide for Daft Dashboard @samstokes (#6882)
- docs: change affiliation for maintainer @gweaverbiodev (#6851)
✅ Tests
- test: restore fixed-size list parquet roundtrip @TuodiAunty (#6895)
- test(iceberg): make predicate-pushdown limit test order-deterministic @samstokes (#6843)
👷 CI
- ci(issues): auto-label issues from component selections @BABTUNA (#6820)
- ci: fix dependency check on external prs @srilman (#6737)
🔧 Maintenance
- chore: Revert "feat(lance): partitioned reads/writes" @universalmind303 (#6907)
👋 New Contributors
- @mytsvy made their first contribution in #6812
- @TuodiAunty made their first contribution in #6895
Full Changelog: v0.7.10...v0.7.11