Skip to content

docs(design): multi-file delta-apply pipeline (#1079)#3935

Merged
oferchen merged 1 commit into
masterfrom
design/multi-file-delta-apply-pipeline
May 7, 2026
Merged

docs(design): multi-file delta-apply pipeline (#1079)#3935
oferchen merged 1 commit into
masterfrom
design/multi-file-delta-apply-pipeline

Conversation

@oferchen
Copy link
Copy Markdown
Owner

@oferchen oferchen commented May 7, 2026

Summary

Test plan

Concise design for a receiver-side multi-file delta-apply pipeline
that overlaps per-file apply across in-flight files while preserving
strict wire-NDX order at acknowledgement and disk-commit boundaries.
Composes the existing ReceiverDeltaPipeline trait (#1543), bounded
work queue, and BoundedReorderBuffer (#1407). Threshold gate at
PARALLEL_STAT_THRESHOLD=64 (#1547). Risks documented: head-of-line
stall (#1883) and spill-to-tempfile pending (#1884).
@github-actions github-actions Bot added the documentation Improvements or additions to documentation label May 7, 2026
@oferchen oferchen merged commit 5d15fbe into master May 7, 2026
8 checks passed
@oferchen oferchen deleted the design/multi-file-delta-apply-pipeline branch May 8, 2026 03:50
oferchen added a commit that referenced this pull request May 18, 2026
Concise design for a receiver-side multi-file delta-apply pipeline
that overlaps per-file apply across in-flight files while preserving
strict wire-NDX order at acknowledgement and disk-commit boundaries.
Composes the existing ReceiverDeltaPipeline trait (#1543), bounded
work queue, and BoundedReorderBuffer (#1407). Threshold gate at
PARALLEL_STAT_THRESHOLD=64 (#1547). Risks documented: head-of-line
stall (#1883) and spill-to-tempfile pending (#1884).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant