Skip to content

docs(design): evaluate PARALLEL_STAT_THRESHOLD for NFS/FUSE (#1084)#3923

Merged
oferchen merged 1 commit into
masterfrom
design/parallel-stat-nfs-fuse-eval
May 7, 2026
Merged

docs(design): evaluate PARALLEL_STAT_THRESHOLD for NFS/FUSE (#1084)#3923
oferchen merged 1 commit into
masterfrom
design/parallel-stat-nfs-fuse-eval

Conversation

@oferchen
Copy link
Copy Markdown
Owner

@oferchen oferchen commented May 7, 2026

Summary

  • Design note for issue Add CLI debug flag handling and propagate to fallback #1084 motivating per-filesystem PARALLEL_STAT_THRESHOLD values.
  • Proposes statfs.f_type (or f_fstypename on macOS, GetVolumeInformationW on Windows) detection in fast_io::fs_kind and an FsKind -> threshold table that drops the gate to 8 on NFS/SMB and 16 on FUSE while preserving 64 for local fast filesystems.
  • Sketches a per-device cache and enumerates misdetection risks (bind mounts, overlayfs, mapped drives, magic-number drift).

Test plan

  • No code change in this PR; follow-up implementation PR will add unit tests for detect_fs_kind and integration coverage for the receiver call site.
  • Empirical thresholds will be revisited once Support leading signs in bwlimit parsing #1083 publishes profile data.

Design note motivating per-filesystem thresholds for the receiver's
parallel stat refresh. Captures detection strategy via statfs magic
numbers, a starting threshold table, an implementation sketch with
a per-device cache, and the misdetection risks on bind mounts and
overlay filesystems.
@github-actions github-actions Bot added the documentation Improvements or additions to documentation label May 7, 2026
@oferchen oferchen merged commit 7e18047 into master May 7, 2026
8 checks passed
@oferchen oferchen deleted the design/parallel-stat-nfs-fuse-eval branch May 8, 2026 03:50
oferchen added a commit that referenced this pull request May 18, 2026
…3923)

Design note motivating per-filesystem thresholds for the receiver's
parallel stat refresh. Captures detection strategy via statfs magic
numbers, a starting threshold table, an implementation sketch with
a per-device cache, and the misdetection risks on bind mounts and
overlay filesystems.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant