Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Github] Make CI container build more reliable #83707

Merged

Conversation

boomanaiden154
Copy link
Contributor

This patch increases the reliability of the CI container build (that was failing consistently before this patch) by fixing some transient space issues. During the stage2 build setup, the tar archive was pulled in from the artifact and placed into $GITHUB_WORKSPACE, almost filling it. Podman while running podman load uses additional space on the same drive as $GITHUB_WORKSPACE, eventually running out of space. This patch moves the downloaded tar archive to /mnt/podman, which has significantly more space, and avoids this problem.

Fixes #83142.

This patch increases the reliability of the CI container build (that was
failing consistently before this patch) by fixing some transient space
issues. During the stage2 build setup, the tar archive was pulled in
from the artifact and placed into $GITHUB_WORKSPACE, almost filling it.
Podman while running podman load uses additional space on the same drive
as $GITHUB_WORKSPACE, eventually running out of space. This patch moves
the downloaded tar archive to /mnt/podman, which has significantly more
space, and avoids this problem.

Fixes llvm#83142.
@llvmbot
Copy link
Collaborator

llvmbot commented Mar 3, 2024

@llvm/pr-subscribers-github-workflow

Author: Aiden Grossman (boomanaiden154)

Changes

This patch increases the reliability of the CI container build (that was failing consistently before this patch) by fixing some transient space issues. During the stage2 build setup, the tar archive was pulled in from the artifact and placed into $GITHUB_WORKSPACE, almost filling it. Podman while running podman load uses additional space on the same drive as $GITHUB_WORKSPACE, eventually running out of space. This patch moves the downloaded tar archive to /mnt/podman, which has significantly more space, and avoids this problem.

Fixes #83142.


Full diff: https://github.com/llvm/llvm-project/pull/83707.diff

1 Files Affected:

  • (modified) .github/workflows/build-ci-container.yml (+5-1)
diff --git a/.github/workflows/build-ci-container.yml b/.github/workflows/build-ci-container.yml
index 3f2bf57eb85088..28fc7de2ee0654 100644
--- a/.github/workflows/build-ci-container.yml
+++ b/.github/workflows/build-ci-container.yml
@@ -77,14 +77,18 @@ jobs:
           cp ./.github/workflows/containers/github-action-ci/storage.conf ~/.config/containers/storage.conf
           podman info
 
+        # Download the container image into /mnt/podman rather than
+        # $GITHUB_WORKSPACE to avoid space limitations on the default drive
+        # and use the permissions setup for /mnt/podman.
       - name: Download stage1-toolchain
         uses: actions/download-artifact@v4
         with:
           name: stage1-toolchain
+          path: /mnt/podman
 
       - name: Load stage1-toolchain
         run: |
-          podman load -i stage1-toolchain.tar
+          podman load -i /mnt/podman/stage1-toolchain.tar
 
       - name: Build Container
         working-directory: ./.github/workflows/containers/github-action-ci/

@boomanaiden154 boomanaiden154 merged commit 09b34b9 into llvm:main Mar 3, 2024
8 checks passed
@sudonatalie
Copy link
Member

Thanks for looking into this @boomanaiden154 ! 🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[infra] Build CI container workflow failing
4 participants