Skip to content

v0.6.4 — Adopt dldb v1.1.7 write-path optimization

Latest
Latest

Choose a tag to compare

View all tags
@hsballoon hsballoon released this 20 Sep 12:00
v0.6.4
70bd327

Highlights

  • Upgrade the SDK dependency from dldb-v1.1.6 to dldb-v1.1.7.
  • Adopt dldb's HASH write-path optimization for add() and upsert().
  • Avoid unnecessary bucket-splitting and data copies when a batch maps to a single HASH bucket.
  • Preserve the existing SDK and dldb API behavior for existing callers.
  • Keep multi-bucket batch writes supported with the existing partitioning behavior.

Compatibility

  • No application code changes are required for existing add(), upsert(), update(), or query calls.
  • The optimization is implemented in dldb; the SDK only updates the pinned dldb dependency.
  • Existing landing partial-upsert support remains available through insert_missing=False.
  • Serving ETL continues to use the default complete-row upsert behavior.

Dependency

This release installs dldb from:

https://github.com/DeepLink-org/Persisting.git@dldb-v1.1.7#subdirectory=persisting/dldb

Notes

The reduced-copy path applies when all records in a batch belong to one HASH bucket. Batches spanning multiple buckets continue to be split and written per bucket as before.

Assets 2
Loading