Skip to content

Conversation

@the8472
Copy link
Member

@the8472 the8472 commented Oct 25, 2025

Another attempt at #82099. The "free up disk space" step is taking 10m, that's a bit much.

@rustbot rustbot added A-CI Area: Our Github Actions CI A-testsuite Area: The testsuite used to check the correctness of rustc S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. T-infra Relevant to the infrastructure team, which will review and decide on the PR/issue. labels Oct 25, 2025
@rust-log-analyzer

This comment has been minimized.

@the8472 the8472 force-pushed the ci-ext4-tweaks branch 2 times, most recently from 7c16001 to 026314e Compare October 25, 2025 08:57

if isLinux && [[ $(findmnt -n /) =~ "ext4" ]] ; then
# noauto_da_alloc since auto_da_alloc causes sync IO for some common file creation patterns
# lazytime avoids sync IO when (rel)atime updates are applied
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is it possible to use noatime here?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Deleting stuff doesn't just update atime but also ctime and mtime, so I don't think noatime would make a difference here.

Anyway, the settings don't seem to make much of a difference, so this might not be due to sync-write-latency but due to read latency (enumerating the directories) or just being IOPS-starved (anemic cloud hardware).
I'll try running iostat alongside the deletion.

@the8472
Copy link
Member Author

the8472 commented Oct 26, 2025

Device            r/s     rkB/s   rrqm/s  %rrqm r_await rareq-sz     w/s     wkB/s   wrqm/s  %wrqm w_await wareq-sz     d/s     dkB/s   drqm/s  %drqm d_await dareq-sz     f/s f_await  aqu-sz  %util
sda            161.40    966.60    80.25  33.21    6.24     5.99    1.20      8.20     0.00   0.00    0.17     6.83    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    1.01  95.50

Looks like this actually limited by read latency.

@the8472 the8472 force-pushed the ci-ext4-tweaks branch 6 times, most recently from fc302e1 to 549db0c Compare October 26, 2025 13:09
@rust-log-analyzer

This comment has been minimized.

@the8472 the8472 force-pushed the ci-ext4-tweaks branch 2 times, most recently from 14c1db1 to 78306cb Compare October 26, 2025 13:31
@the8472
Copy link
Member Author

the8472 commented Oct 26, 2025

Parallel deletion seems to help a bit, but not enough, trying something else in #148146

@the8472 the8472 closed this Oct 26, 2025
@rustbot rustbot removed the S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. label Oct 26, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

A-CI Area: Our Github Actions CI A-testsuite Area: The testsuite used to check the correctness of rustc T-infra Relevant to the infrastructure team, which will review and decide on the PR/issue.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants