v2.0.0
What's Changed
- Expose WorkerServiceServer publicly by @gabrielkerr in #406
- Asynchronous distributed planning by @gabotechs in #383
- Factor out UUID functions into common module by @gabotechs in #400
- Refactor send plan task to a struct by @gabotechs in #401
- refactor / add benches for shuffle and transport shuffling by @gene-bordegaray in #408
- Remove batch_coalescing_below_network_boundaries rule by @EdsonPetry in #407
- Leverage PartialReduce AggregationExec mode to reduce shuffle size by @nchu05 in #396
- Introduce WorkUnit concept for streaming units of work to leaf nodes at runtime by @gabotechs in #411
- Add msg count metric for worker connection pool metrics by @gabotechs in #414
- Fix metrics loss on early stream termination by @LiaCastaneda in #415
- Buffering improvements to inter-worker communication by @gabotechs in #419
- Remove trailing whitespace from plan task display by @gene-bordegaray in #420
- fix union recomputing child properties by @gene-bordegaray in #423
- Update Readme by @Rich-T-kid in #433
- Cherry pick LocalWorkerContext by @gabotechs in #435
- Task Routing with the Task Estimator: Allow users to map tasks to URLs by @JSOD11 in #409
- speed up test exeuction time by transitioning to in_memory worker by @Rich-T-kid in #428
- Fix TPCDS runner explain analyze await by @gene-bordegaray in #442
- swap std for hashbrown by @Rich-T-kid in #444
- Remove artificial broadcast task limit in the build side by @gabotechs in #422
- Refactor Stage struct to be more explicit about states by @gabotechs in #424
- set up git hooks by @Rich-T-kid in #446
- Harden work unit tests by @gabotechs in #418
- Create Clippy rule dis-allowing std::collection::hashmap by @Rich-T-kid in #447
- feat: use tpchgen-rs for benchmarks by @clflushopt in #443
- Remove 2-pass planner (annotator + distribution) in favor of a 1-pass planner by @gabotechs in #416
- Refactor coordinator-worker channel code by @gabotechs in #425
- Refactor distributed.rs into coordinator module by @gabotechs in #426
- Add reproducer tests for ChildrenIsolatorUnionExec bug by @gabotechs in #455
- Un-ignore test by @Rich-T-kid in #452
- Fix ChildrenIsolatorUnionExec budget mismatch via weight-based proportional allocation by @gabotechs in #456
- update benchmark docs to match --path -> --dataset rename by @kentkr in #466
- push fetches into network coalesces by @gene-bordegaray in #468
- Use in-memory comms if both workers involved in an exchange happen to be the same by @gabotechs in #427
- Factor out distributed recursion by @gabotechs in #469
- Introduce DistributedLeafExec by @gabotechs in #467
- Add WorkUnitFileScanConfig for testing WorkUnits with real data by @gabotechs in #448
- Add metrics to WorkUnitFeed by @gabotechs in #453
- Collect stage-level metrics by @gabotechs in #461
- Report distributed tasks in remote benchmarks by @gabotechs in #462
- Fix early worker partition drop in RemoteWorkerConnection demux by @gabotechs in #473
- Fix ClickBench EventDate column type (UInt16 → Date32) by @gabotechs in #472
- Regenerate tpcds plans by @gabotechs in #481
- No eager buffering in network connections by @gabotechs in #477
- Rebalance files globally across the partitions produced by FileScanConfigTaskEstimator by @shehab-ali in #450
- Make DistributedTaskContext Copy by @homa31 in #475
- Benchmarks housekeeping by @gabotechs in #485
- Upgrade DF to v54 by @LiaCastaneda in #465
- Fix benchmarks build: remove nonexistent with_distributed_dynamic_task_count call by @EdsonPetry in #488
- Add broadcast support for cross and nested loop joins by @EdsonPetry in #484
- fix: await async metric delivery in metrics collection tests by @sjhddh in #490
- unskip metric test by @Rich-T-kid in #493
- Add NetworkBoundaryBuilder argument to inject_network_boundaries by @gabotechs in #463
- Add MaxGauge metric by @gabotechs in #464
- Lazily set the producer head at execution time by @gabotechs in #478
- #313: consolidate test plan helpers by @kentkr in #491
- Chunk work unit feeds by @gabotechs in #492
- Rework leaf task estimation around bytes-per-partition + per-task DistributedLeafExec visualization by @gabotechs in #496
- Improve docs and examples by @gabotechs in #494
New Contributors
- @nchu05 made their first contribution in #396
- @Rich-T-kid made their first contribution in #433
- @clflushopt made their first contribution in #443
- @kentkr made their first contribution in #466
- @shehab-ali made their first contribution in #450
- @homa31 made their first contribution in #475
- @sjhddh made their first contribution in #490
Full Changelog: v1.0.0...v2.0.0