Skip to content

Cache storage limit exceeded when storing a cache that's under 10GB  #2

Open
actions/cache
#1337
@Napster134

Description

@Napster134

Hi all,

It seems there's an issue with the total expected cache size when using buildjet along with buildjets caching action.

For some reason, I get this error:

Screenshot 2024-02-13 at 8 54 45 AM
Warning: Failed to save: Cache size of ~6148 MB (6446280578 B) is over the 10GB limit, not saving cache.
Cache saved with key: docker-image-cache4-Linux

However, if I switch the caching action to use: runs-on: ubuntu-latest along with uses: actions/cache@v4 then it works as expected. Example:

Screenshot 2024-02-13 at 8 45 41 AM

Working:

    ---
    name: Test 
    
    on: [ pull_request ]
    
    permissions:
      id-token: write
      contents: read
    
    jobs:
      test:
        env:
          CI: true
    
        runs-on: ubuntu-latest
    
        steps:
          - name: Free Disk Space (Ubuntu)
            uses: jlumbroso/free-disk-space@v1.3.1
    
          - run: mkdir -p ~/docker-image-cache
    
          - id: docker-image-cache
            uses: actions/cache@v4
            with:
                path: ~/docker-image-cache
                key: docker-image-cache4-${{ runner.os }}          
    
          - name: Git checkout my app repos
            uses: myorg/repoName/.github/actions/checkout@v3
    
          - name: Load cache for docker images
            if: steps.docker-image-cache.outputs.cache-hit == 'true'
            run: |
                docker load -i ~/docker-image-cache/myOrgImage1.tar
                docker load -i ~/docker-image-cache/myOrgImage2.tar
                docker load -i ~/docker-image-cache/myOrgImage3.tar
                docker load -i ~/docker-image-cache/myOrgImage4.tar
                docker load -i ~/docker-image-cache/myOrgImage5.tar
    
          - name: Pull the docker images 
            run:  |  
                 cd testApp
                 make pull-images
    
          - name: Create cache for docker images
            if: steps.docker-image-cache.outputs.cache-hit != 'true'
            run: |
                docker image list --format "{{ .Repository }}:{{ .Tag }}"
                docker save -o ~/docker-image-cache/myOrgImage1.tar $(docker image list --format "{{ .Repository }}:{{ .Tag }}" | grep "myOrgImage1")
                docker save -o ~/docker-image-cache/myOrgImage2.tar $(docker image list --format "{{ .Repository }}:{{ .Tag }}" | grep "myOrgImage2")
                docker save -o ~/docker-image-cache/myOrgImage3.tar $(docker image list --format "{{ .Repository }}:{{ .Tag }}" | grep "myOrgImage3")
                docker save -o ~/docker-image-cache/myOrgImage4.tar $(docker image list --format "{{ .Repository }}:{{ .Tag }}" | grep "myOrgImage4")
                docker save -o ~/docker-image-cache/myOrgImage5.tar $(docker image list --format "{{ .Repository }}:{{ .Tag }}" | grep "myOrgImage5")

Not working:

      ---
      name: Test
      
      on: [ pull_request ]
      
      permissions:
        id-token: write
        contents: read
      
      jobs:
        test:
          env:
            CI: true
      
          runs-on: buildjet-4vcpu-ubuntu-2204
      
          steps:
            - name: Free Disk Space (Ubuntu)
              uses: jlumbroso/free-disk-space@v1.3.1
      
            - run: mkdir -p ~/docker-image-cache
      
            - id: docker-image-cache
              uses: buildjet/cache@v4
              with:
                  path: ~/docker-image-cache
                  key: docker-image-cache4-${{ runner.os }}          
      
            - name: Git checkout my app repos
              uses: myorg/repoName/.github/actions/checkout@v3
      
            - name: Load cache for docker images
              if: steps.docker-image-cache.outputs.cache-hit == 'true'
              run: |
                  docker load -i ~/docker-image-cache/myOrgImage1.tar
                  docker load -i ~/docker-image-cache/myOrgImage2.tar
                  docker load -i ~/docker-image-cache/myOrgImage3.tar
                  docker load -i ~/docker-image-cache/myOrgImage4.tar
                  docker load -i ~/docker-image-cache/myOrgImage5.tar
      
          - name: Pull the docker images 
            run:  |  
                 cd testApp
                 make pull-images
      
            - name: Create cache for docker images
              if: steps.docker-image-cache.outputs.cache-hit != 'true'
              run: |
                  docker image list --format "{{ .Repository }}:{{ .Tag }}"
                  docker save -o ~/docker-image-cache/myOrgImage1.tar $(docker image list --format "{{ .Repository }}:{{ .Tag }}" | grep "myOrgImage1")
                  docker save -o ~/docker-image-cache/myOrgImage2.tar $(docker image list --format "{{ .Repository }}:{{ .Tag }}" | grep "myOrgImage2")
                  docker save -o ~/docker-image-cache/myOrgImage3.tar $(docker image list --format "{{ .Repository }}:{{ .Tag }}" | grep "myOrgImage3")
                  docker save -o ~/docker-image-cache/myOrgImage4.tar $(docker image list --format "{{ .Repository }}:{{ .Tag }}" | grep "myOrgImage4")
                  docker save -o ~/docker-image-cache/myOrgImage5.tar $(docker image list --format "{{ .Repository }}:{{ .Tag }}" | grep "myOrgImage5")

Activity

changed the title [-]Cache storage limit exceeded when under 10GB [/-] [+]Cache storage limit exceeded when storing cache under 10GB [/+] on Feb 13, 2024
changed the title [-]Cache storage limit exceeded when storing cache under 10GB [/-] [+]Cache storage limit exceeded when storing a cache that's under 10GB [/+] on Feb 13, 2024
linked a pull request that will close this issue on Feb 23, 2024
Napster134

Napster134 commented on Mar 6, 2024

@Napster134
Author

@Endrix1369 Did ya mean to add something to that comment? It seems like a blank comment

deleted a comment from Endrix1369 on Mar 25, 2024
deleted a comment from Endrix1369 on Mar 25, 2024
deleted a comment from Endrix1369 on Mar 25, 2024
deleted a comment from Endrix1369 on Mar 25, 2024
deleted a comment from Endrix1369 on Mar 25, 2024
deleted a comment from Endrix1369 on Mar 25, 2024
deleted a comment from Endrix1369 on Mar 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

      Development

      Participants

      @Napster134

      Issue actions

        Cache storage limit exceeded when storing a cache that's under 10GB · Issue #2 · BuildJet/cache