v0.7.0
What's Changed
- Connectors: Added Azure Blob Storage (
az://) and Azure Data Lake Storage
Gen2 (adls://,abfss://) source and destination adapters, backed by
adlfs. Supports account-key, SAS-token, and service-principal auth.
Thanks, @hampsterx. - Connectors: Fixed remote filesystem destinations (Azure Blob, GCS, S3)
aborting at the end of a load because the requiredpost_loadhook was
missing from the shared base class. Thanks, @hampsterx. - Filesystem: Added
#key=valuereader hint channel to source URIs
to propagate options to source implementations. Thanks, @hampsterx. - Filesystem: Added readers for CBOR, MessagePack, XML and YAML formats.
Thanks, @hampsterx. - Filesystem: Added readers for Excel workbook (XLSX) and OpenDocument
spreadsheet (ODS) formats. - Filesystem: Fixed and documented semantics of append/replace strategy
and append/full-refresh behaviour. Thanks, @hampsterx. - Dependencies: Updated to dlt 1.29
Details
- feat(filesystem): add Azure Blob Storage + ADLS Gen2 adapters by @hampsterx in #182
- feat(filesystem): add #key=value reader-hint channel to source URIs by @hampsterx in #183
- Chore: Fix refactoring leftover about reader hints on
AzureSourceby @amotl in #185 - chore(deps): update astral-sh/setup-uv action to v8.3.1 by @renovate[bot] in #184
- chore(deps): update astral-sh/setup-uv action to v8.3.2 by @renovate[bot] in #189
- fix(deps): update dependency ty to v0.0.57 by @renovate[bot] in #190
- fix(deps): update dependency ty to v0.0.58 by @renovate[bot] in #193
- fix(deps): update dependency pyarrow to v25 by @renovate[bot] in #194
- docs: improve core and target docstrings by @hampsterx in #197
- feat(filesystem): add MessagePack and CBOR read support by @hampsterx in #196
- Tests: Refactor test cases to use generic db helpers by @amotl in #198
- docs(incremental): document filesystem append/full-refresh behaviour by @hampsterx in #199
- fix(deps): update dependency ty to v0.0.59 by @renovate[bot] in #203
- feat(filesystem): honour explicit append/replace strategy by @hampsterx in #204
- Filesystem: Add reader for Excel XLSX files by @amotl in #123
- Filesystem: Propagate reader hints to Polars readers, with type casting by @amotl in #216
- Filesystem: Harmonize CSV reading with Excel reading by @coderabbitai[bot] in #217
- fix(deps): update dependency dlt to <1.30 by @renovate[bot] in #207
- fix(deps): update dependency typer to <0.28 by @renovate[bot] in #221
- Documentation: Improve filesystem / file format overview by @amotl in #225
- Filesystem: Add reader for OpenDocument spreadsheet (ODS) files by @amotl in #222
- feat(filesystem): add XML and YAML read support by @hampsterx in #205
New Contributors
- @coderabbitai[bot] made their first contribution in #217
Full Changelog: v0.6.0...v0.7.0