Skip to content

fix(kube): add dedicated DinD storage volume for ARC runners#7719

Merged
h0lybyte merged 1 commit intodevfrom
trunk/arc-dind-storage-1772859868
Mar 7, 2026
Merged

fix(kube): add dedicated DinD storage volume for ARC runners#7719
h0lybyte merged 1 commit intodevfrom
trunk/arc-dind-storage-1772859868

Conversation

@h0lybyte
Copy link
Member

@h0lybyte h0lybyte commented Mar 7, 2026

Summary

  • Add dind-storage emptyDir volume mounted at /var/lib/docker in the DinD sidecar
  • Without this, Docker BuildKit stores images/layers in the container overlay layer, causing exit 130 during layer extraction

Root cause

ARC runner pods use Docker-in-Docker (DinD) but had no volume for /var/lib/docker. BuildKit wrote all image layers to the container's writable overlay, which is slow and storage-constrained. The Docker build consistently died during base image extraction (exit code 130 / SIGINT).

Changes

File Change
apps/kube/github/runners/manifests/values.yaml Add dind-storage emptyDir + mount at /var/lib/docker

Deploy order

  1. Merge this PR and apply the ARC runner manifest to the cluster
  2. Merge PR fix(ci): revert axum-kbve-e2e to ubuntu-latest runner #7718 (routes axum-kbve-e2e to arc-runner-set + restores Dockerfile to 8192MB)

Test plan

  • ARC runner pods restart with the new volume
  • axum-kbve-e2e Docker build succeeds on arc-runner-set

🤖 Generated with Claude Code

Without a volume at /var/lib/docker, Docker BuildKit stores all
images and layers in the container overlay layer, which is slow
and space-constrained. Adding an emptyDir gives BuildKit proper
disk access on the node's ephemeral storage.
@github-actions
Copy link
Contributor

github-actions bot commented Mar 7, 2026

Dependency Review

✅ No vulnerabilities or license issues or OpenSSF Scorecard issues found.

Scanned Files

None

@h0lybyte h0lybyte merged commit ded47ac into dev Mar 7, 2026
5 checks passed
@h0lybyte h0lybyte deleted the trunk/arc-dind-storage-1772859868 branch March 7, 2026 05:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant