v0.6.2
Overview
You can find the release summary in the documentation.
The PySail Python package is available on PyPI.
What's Changed
- chore: allow skipping Python catalog integration tests in CI by @linhr in #1813
- deps(npm): bump the all group with 8 updates by @dependabot[bot] in #1799
- refactor: expand the usage of
OptionLayerby @linhr in #1795 - feat: add from_json by @twsl in #1818
- fix: remove incorrect udf match for SparkFromCSV in try_encode_udf by @shehabgamin in #1828
- feat: support deletion vector in merge operation for Delta Lake by @lonless9 in #1809
- feat: improve partition pruning for Iceberg by @lonless9 in #1794
- fix: match Spark's
from_csvcolumn display name (drop schema/options arguments) by @Copilot in #1821 - feat: improve checkpointing for Delta Lake by @lonless9 in #1796
- feat: improve operation metrics reporting for Delta Lake by @lonless9 in #1761
- perf: implement preimage hook on last_day for Parquet filter pushdown by @davidlghellin in #1797
- feat: implement
bitmap_and_aggaggregate function by @Copilot in #1804 - feat: add
uniformfunction by @davidlghellin in #1074 - feat: support custom file extensions for Parquet listings by @Shaked98 in #1786
- docs: cleaning up readme part 1 by @shehabgamin in #1833
- fix: match Spark's behavior of ignoring file extension when reading by @shehabgamin in #1825
- fix: support registered Python UDAFs as window functions by @pomykalakyle in #1832
- docs: cleanup readme and fix broken links by @shehabgamin in #1840
- deps(cargo): bump the all group with 5 updates by @dependabot[bot] in #1848
- deps(npm): bump the all group with 5 updates by @dependabot[bot] in #1847
- feat: add Kubernetes worker pod cleanup configuration by @Copilot in #1850
- revert: add Kubernetes worker pod cleanup configuration by @linhr in #1860
- chore: prepare v0.6.2 by @shehabgamin in #1858
New Contributors
Full Changelog: v0.6.1...v0.6.2