Skip to content

docs(audits): profile 100K metadata application time (#1046)#3926

Merged
oferchen merged 1 commit into
masterfrom
audits/100k-metadata-apply-profile
May 7, 2026
Merged

docs(audits): profile 100K metadata application time (#1046)#3926
oferchen merged 1 commit into
masterfrom
audits/100k-metadata-apply-profile

Conversation

@oferchen
Copy link
Copy Markdown
Owner

@oferchen oferchen commented May 7, 2026

Summary

  • Audits crates/metadata/src/apply/ pipeline (chown -> chmod -> utimensat -> crtime, plus xattr / ACL fan-out) and maps each step to its path-based and fd-based syscall.
  • Quantifies the 300K-syscall floor at 100K files with -aHAX --owner --group, lays out an strace -c profile plan inside the rsync-profile container, and confirms rayon par_iter wiring via transfer::parallel_io::map_blocking (threshold 64, cross-ref Support leading signs in bwlimit parsing #1083 stat-batch).
  • Enumerates optimization candidates: io_uring statx batches, fchownat(AT_EMPTY_PATH) over O_PATH dir fds, skip-if-equal short-circuit before utimensat, coalesced setxattr, NUMA-aware rayon pool.

Closes #1046.

Test plan

  • docs-only change; CI fmt/clippy/build matrix green
  • Reviewer confirms syscall table matches crates/metadata/src/apply/{ownership,permissions,timestamps}.rs

Audit metadata apply pipeline (chmod/chown/utimensat/setxattr/setfacl),
quantify the 300K-syscall floor at 100K files, plan strace-c profiling,
confirm rayon par_iter wiring through apply_metadata_from_file_entry
(threshold 64), and enumerate io_uring statx, O_PATH fchownat, and
skip-if-equal optimization candidates.
@github-actions github-actions Bot added the documentation Improvements or additions to documentation label May 7, 2026
@oferchen oferchen merged commit 6ddd572 into master May 7, 2026
8 checks passed
@oferchen oferchen deleted the audits/100k-metadata-apply-profile branch May 8, 2026 03:50
oferchen added a commit that referenced this pull request May 18, 2026
Audit metadata apply pipeline (chmod/chown/utimensat/setxattr/setfacl),
quantify the 300K-syscall floor at 100K files, plan strace-c profiling,
confirm rayon par_iter wiring through apply_metadata_from_file_entry
(threshold 64), and enumerate io_uring statx, O_PATH fchownat, and
skip-if-equal optimization candidates.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant