Skip to content

v0.7.0

Choose a tag to compare

@amotl amotl released this 16 Jul 08:55

What's Changed

  • Connectors: Added Azure Blob Storage (az://) and Azure Data Lake Storage
    Gen2 (adls://, abfss://) source and destination adapters, backed by
    adlfs. Supports account-key, SAS-token, and service-principal auth.
    Thanks, @hampsterx.
  • Connectors: Fixed remote filesystem destinations (Azure Blob, GCS, S3)
    aborting at the end of a load because the required post_load hook was
    missing from the shared base class. Thanks, @hampsterx.
  • Filesystem: Added #key=value reader hint channel to source URIs
    to propagate options to source implementations. Thanks, @hampsterx.
  • Filesystem: Added readers for CBOR, MessagePack, XML and YAML formats.
    Thanks, @hampsterx.
  • Filesystem: Added readers for Excel workbook (XLSX) and OpenDocument
    spreadsheet (ODS) formats.
  • Filesystem: Fixed and documented semantics of append/replace strategy
    and append/full-refresh behaviour. Thanks, @hampsterx.
  • Dependencies: Updated to dlt 1.29

Details

  • feat(filesystem): add Azure Blob Storage + ADLS Gen2 adapters by @hampsterx in #182
  • feat(filesystem): add #key=value reader-hint channel to source URIs by @hampsterx in #183
  • Chore: Fix refactoring leftover about reader hints on AzureSource by @amotl in #185
  • chore(deps): update astral-sh/setup-uv action to v8.3.1 by @renovate[bot] in #184
  • chore(deps): update astral-sh/setup-uv action to v8.3.2 by @renovate[bot] in #189
  • fix(deps): update dependency ty to v0.0.57 by @renovate[bot] in #190
  • fix(deps): update dependency ty to v0.0.58 by @renovate[bot] in #193
  • fix(deps): update dependency pyarrow to v25 by @renovate[bot] in #194
  • docs: improve core and target docstrings by @hampsterx in #197
  • feat(filesystem): add MessagePack and CBOR read support by @hampsterx in #196
  • Tests: Refactor test cases to use generic db helpers by @amotl in #198
  • docs(incremental): document filesystem append/full-refresh behaviour by @hampsterx in #199
  • fix(deps): update dependency ty to v0.0.59 by @renovate[bot] in #203
  • feat(filesystem): honour explicit append/replace strategy by @hampsterx in #204
  • Filesystem: Add reader for Excel XLSX files by @amotl in #123
  • Filesystem: Propagate reader hints to Polars readers, with type casting by @amotl in #216
  • Filesystem: Harmonize CSV reading with Excel reading by @coderabbitai[bot] in #217
  • fix(deps): update dependency dlt to <1.30 by @renovate[bot] in #207
  • fix(deps): update dependency typer to <0.28 by @renovate[bot] in #221
  • Documentation: Improve filesystem / file format overview by @amotl in #225
  • Filesystem: Add reader for OpenDocument spreadsheet (ODS) files by @amotl in #222
  • feat(filesystem): add XML and YAML read support by @hampsterx in #205

New Contributors

Full Changelog: v0.6.0...v0.7.0