Skip to content

docs(design): per-operation adaptive parallelism thresholds (#1554)#3936

Merged
oferchen merged 1 commit into
masterfrom
design/per-op-adaptive-thresholds
May 7, 2026
Merged

docs(design): per-operation adaptive parallelism thresholds (#1554)#3936
oferchen merged 1 commit into
masterfrom
design/per-op-adaptive-thresholds

Conversation

@oferchen
Copy link
Copy Markdown
Owner

@oferchen oferchen commented May 7, 2026

Summary

  • Replace the single fixed PARALLEL_STAT_THRESHOLD = 64 with per-operation thresholds (stat / signature / metadata / delete) tuned to each call site's cost profile.
  • Add an EMA-based adaptive layer that refines thresholds in-run, with persistence keyed by filesystem type for NFS/FUSE robustness (Add CLI debug flag handling and propagate to fallback #1084).
  • Define configuration precedence across env vars, oc-rsync.toml, and a learned-state file.

Tracking: #1554. Cross-references: #1083, #1084, #1085.

Test plan

  • Design doc only; no code changes. Implementation tracked separately.

@github-actions github-actions Bot added the documentation Improvements or additions to documentation label May 7, 2026
@oferchen oferchen merged commit fdefca1 into master May 7, 2026
8 checks passed
@oferchen oferchen deleted the design/per-op-adaptive-thresholds branch May 8, 2026 03:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant