v0.3.9 limited python support for predicate pushdown
By default pyarrow compute Expressions doesn't serialize to sql strings. This patch release enables a limited set of filter pushdowns via python. Supported syntax:
- field references
- Operators: > < >= <= = == !=
- conjunctions / disjunctions
This enables querying via duckdb without needing to load the whole dataset into memory first.
e.g., duckdb.query("SELECT * FROM dataset WHERE id=5")
What's Changed
Full Changelog: v0.3.8...v0.3.9