Sd optimize streaming merge#3

Merged

federico-martinez-invgate merged 13 commits into

mainfrom

sd-optimize-streaming-merge

Jul 11, 2026

Commits on Jul 11, 2026

bench+docs: optimize RAM/perf baseline harness + streaming-merge design & plan
federico-martinez-invgate
committed
zsl: add streaming stored-fields writer (StoredStreamWriter)
federico-martinez-invgate
committed
zsl: add streaming term-dict/postings writer (TermDictStreamWriter)
federico-martinez-invgate
committed
test(zsl): de-tautologize stream vs batch term-dict writer test
federico-martinez-invgate
committed
zsl: add lazy sorted term cursor for the future streaming merge
federico-martinez-invgate
committed
bench: add existing-index mode to optimize_bench (measure optimize on a real index copy)
federico-martinez-invgate
committed
feat(zsl): add streaming CFS assembler (write_cfs_streaming)
federico-martinez-invgate
committed
fix(zsl): guard against silent CFS corruption on Path source length mismatch
federico-martinez-invgate
committed
feat(zsl): bounded-memory streaming k-way merge for optimize()
federico-martinez-invgate
committed
test(zsl): de-tautologize stored writer test, add empty-merge gate, doc note
federico-martinez-invgate
committed
fix(zsl): prune stale segments_N manifests after each generation flip
federico-martinez-invgate
committed
docs: document streaming bounded-memory optimize() + segments_N pruning + optimize-per-feed guidance
federico-martinez-invgate
committed
style: cargo fmt --all (fix CI fmt check)
federico-martinez-invgate
committed