Repository navigation
v0.21.0
What's Changed
-
Connector: Verified support for DuckDB 2.x
-
Filesystem: An ORC export that PyArrow refuses, such as a time column under
--loader-file-format parquet, no longer leaves a zero-byte file at the
destination path or truncates a file already there. dlt-filesystem 0.22 is now
the minimum version. -
Incremental strategies
upsertandcdc.upsertinserts and updates by
primary key without deleting.cdckeeps the destination equal to the source,
deleting the rows the source no longer holds; it is accepted for SQL database
sources only, and likescd2it rejects options that read part of a table. Both
need a primary key, declared by the table or named with--primary-key. dlt 1.31
is now the minimum version.scd2now also rejects--interval-start/
--interval-endon aquery:table that binds them, which windowed the read the
same way. A plainmergeordelete+insertnow names the destination's default
merge strategy, so a strategy an earlier load stored on the table, such ascdc,
no longer carries over to it; a table loaded withscd2and then with a plain
mergeis merged with the destination's default and keeps no history for the
keys that load reads.upsertandcdcare rejected up front on a destination
that has no such strategy for the table. See Incremental loading.
Details
- Connector: Verify support for DuckDB 2.x by @amotl in #419
- Incremental: Add the
upsertandcdcstrategies by @hampsterx in #422 - Filesystem: Expect no file after a refused ORC write by @hampsterx in #426
- fix(deps): update dependency ty to v0.0.91 by @renovate[bot] in #423
- chore(deps): update astral-sh/setup-uv action to v10.3.2 by @renovate[bot] in #421
Full Changelog: v0.20.0...v0.21.0