v0.1.11

Changes

✨ New Features

• [FEAT] [New Query Plan] Add support for Projection and Coalesce, enable many tests @clarkzinzow (#1256)
• [FEAT] [New Query Planner] Add support for Concat. @clarkzinzow (#1254)
• [FEAT] [New Query Planner] Add support for tabular writes. @clarkzinzow (#1252)
• [FEAT] Multi-partition aggregate; Coalesce @xcharleslin (#1249)
• [FEAT] [New Query Planner] Add support for Sort, Repartition, and Distinct in new query planner. @clarkzinzow (#1248)
• [FEAT] Add Azure Support for Native Downloader @samster25 (#1250)
• [FEAT] Locally unique semantic IDs for Expressions @xcharleslin (#1243)
• [FEAT] Read parquet tables with int96 coercion option @jaychia (#1231)
• [FEAT] [New Query Plan] Add support for CSV scans, JSON scans, in-memory scans and caching materialized results. @clarkzinzow (#1246)
• [FEAT] Native Downloader add Retry Config parameters @samster25 (#1244)
• [FEAT] (Single partition only) DataFrame.sum() via Rust planner @xcharleslin (#1230)
• [FEAT] [New Query Planner] Logical --> physical translation, physical plan execution. @clarkzinzow (#1232)
• [FEAT] native parquet correctness checks @samster25 (#1225)
• [FEAT] add session token as input to io config @samster25 (#1224)

🚀 Performance Improvements

• [PERF] Native Parquet Bulk Reader @samster25 (#1233)

👾 Bug Fixes

• [BUG] drop native-tls (openssl) for azure which was a default feature @samster25 (#1251)
• [BUG] Fix decimal byte arrays @jaychia (#1247)
• [BUG] correct type when printing incorrect row count @samster25 (#1226)
• [BUG] try manylinux 2 28 @samster25 (#1214)
• [BUG] downgrade ray to 2.6 @samster25 (#1212)
• [BUG] add explict target for aarch64 linux @samster25 (#1209)
• [BUG] Fix incorrect sign bug for small decimals @xcharleslin (#1204)
• [BUG] Set SSL paths on linux @samster25 (#1203)

📖 Documentation

• [DOCS] Fix daft.read_parquet link @jaychia (#1228)
• [DOCS][CHORE] Add docs for IOConfig and S3Config @jaychia (#1227)

🧰 Maintenance

• [CHORE] Update test to only use store_schema kwarg for pa>=11 @jaychia (#1253)
• [FEAT] (Single partition only) DataFrame.sum() via Rust planner @xcharleslin (#1230)
• [CHORE] [New Query Planner] Introduce LogicalPlanBuilder and QueryPlanner interfaces to hide query planner implementations. @clarkzinzow (#1245)
• [CHORE] LogicalPlan: Add display improvements, and Filter @xcharleslin (#1221)
• [CHORE] Add unit tests for int96 timestamps @jaychia (#1229)
• [DOCS][CHORE] Add docs for IOConfig and S3Config @jaychia (#1227)
• [CHORE] disable mac test for lack of docker @samster25 (#1223)
• [CHORE] Begin integrating Rust Logical Plan with Dataframe API @xcharleslin (#1207)
• [CHORE] integration tests for nightly platform wheels @samster25 (#1219)
• [CHORE] Remove existing LogicalPlan from all execution concepts @xcharleslin (#1208)
• [CHORE] Add endpoints to simulate rate-limiting on AWS S3 buckets @jaychia (#1220)
• [CHORE] Add pytest marker for integration @jaychia (#1211)
• [CHORE] Add s3 fixtures for retrying logic @jaychia (#1206)
• [CHORE] Add developer flag to use Rust query planner @xcharleslin (#1205)
• [CHORE] Rust Logical plan skeleton @xcharleslin (#1192)

⬆️ Dependencies

7 changes

• Bump tempfile from 3.7.0 to 3.7.1 @dependabot (#1238)
• Bump ray[data,default] from 2.5.1 to 2.6.1 @dependabot (#1200)
• Bump numpy from 1.25.1 to 1.25.2 @dependabot (#1199)
• Bump tempfile from 3.6.0 to 3.7.0 @dependabot (#1198)
• Bump serde_json from 1.0.103 to 1.0.104 @dependabot (#1197)
• Bump num-traits from 0.2.15 to 0.2.16 @dependabot (#1196)
• Bump serde from 1.0.171 to 1.0.179 @dependabot (#1195)