Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failing on v1.2.4 #98

Closed
akaszynski opened this issue Mar 8, 2023 · 18 comments
Closed

Failing on v1.2.4 #98

akaszynski opened this issue Mar 8, 2023 · 18 comments
Assignees
Labels
bug Something isn't working

Comments

@akaszynski
Copy link

pyvista/pyvista#3964 has failed since the release of v1.2.4

The logs aren't clear. Do you have any suggestions?

I've even updated the cache version, but the issue persists:

      - uses: awalsh128/cache-apt-pkgs-action@v1.2.4
        with:
          packages: libosmesa6-dev libgl1-mesa-dev python3-tk pandoc git-restore-mtime
          version: 3.1

Full GitHub action log:

2023-02-23T04:04:22.4117825Z Cache not found for input keys: cache-apt-pkgs_19984b10668ecdf6d9ff65268c47d6f4
2023-02-23T04:04:22.4196895Z ##[group]Run ${GITHUB_ACTION_PATH}/post_cache_action.sh \
2023-02-23T04:04:22.4197246Z �[36;1m${GITHUB_ACTION_PATH}/post_cache_action.sh \�[0m
2023-02-23T04:04:22.4197514Z �[36;1m  ~/cache-apt-pkgs \�[0m
2023-02-23T04:04:22.4197724Z �[36;1m  / \�[0m
2023-02-23T04:04:22.4197928Z �[36;1m  "$CACHE_HIT" \�[0m
2023-02-23T04:04:22.4198147Z �[36;1m  "$EXEC_INSTALL_SCRIPTS" \�[0m
2023-02-23T04:04:22.4198368Z �[36;1m  "$DEBUG" \�[0m
2023-02-23T04:04:22.4198569Z �[36;1m  "$PACKAGES"�[0m
2023-02-23T04:04:22.4198902Z �[36;1mfunction create_list { local list=$(cat ~/cache-apt-pkgs/manifest_${1}.log | tr '\n' ','); echo ${list:0:-1}; };�[0m
2023-02-23T04:04:22.4199312Z �[36;1mecho "package-version-list=$(create_list main)" >> $GITHUB_OUTPUT�[0m
2023-02-23T04:04:22.4199687Z �[36;1mecho "all-package-version-list=$(create_list all)" >> $GITHUB_OUTPUT�[0m
2023-02-23T04:04:22.4251852Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2023-02-23T04:04:22.4252117Z env:
2023-02-23T04:04:22.4252307Z   USE_CACHE: true
2023-02-23T04:04:22.4252519Z   PYVISTA_OFF_SCREEN: True
2023-02-23T04:04:22.4252732Z   ALLOW_PLOTTING: true
2023-02-23T04:04:22.4252958Z   SHELLOPTS: errexit:pipefail
2023-02-23T04:04:22.4253244Z   pythonLocation: /opt/hostedtoolcache/Python/3.11.2/x64
2023-02-23T04:04:22.4253581Z   PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.11.2/x64/lib/pkgconfig
2023-02-23T04:04:22.4253914Z   Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.11.2/x64
2023-02-23T04:04:22.4254221Z   Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.11.2/x64
2023-02-23T04:04:22.4254512Z   Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.11.2/x64
2023-02-23T04:04:22.4254812Z   LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.11.2/x64/lib
2023-02-23T04:04:22.4255101Z   CACHE_KEY: 19984b10668ecdf6d9ff65268c47d6f4
2023-02-23T04:04:22.4255332Z   CACHE_HIT: 
2023-02-23T04:04:22.4255537Z   EXEC_INSTALL_SCRIPTS: false
2023-02-23T04:04:22.4255737Z   DEBUG: false
2023-02-23T04:04:22.4256031Z   PACKAGES: libosmesa6-dev libgl1-mesa-dev python3-tk pandoc git-restore-mtime
2023-02-23T04:04:22.4256331Z ##[endgroup]
2023-02-23T04:04:22.4533360Z 04:04:22 Clean installing and caching 5 package(s).
2023-02-23T04:04:22.4533890Z 
2023-02-23T04:04:22.4548222Z 04:04:22 Package list:
2023-02-23T04:04:23.3899420Z 04:04:23 - git-restore-mtime:2019.11-1
2023-02-23T04:04:24.3396939Z 04:04:24 - libgl1-mesa-dev:21.2.6-0ubuntu0.1~20.04.2
2023-02-23T04:04:25.2882823Z 04:04:25 - libosmesa6-dev:21.2.6-0ubuntu0.1~20.04.2
2023-02-23T04:04:26.2314942Z 04:04:26 - pandoc:2.5-3build2
2023-02-23T04:04:27.1877056Z 04:04:27 - python3-tk:3.8.10-0ubuntu1~20.04
2023-02-23T04:04:27.1893390Z 04:04:27 Writing main packages manifest to /home/runner/cache-apt-pkgs/manifest_main.log...
2023-02-23T04:04:27.1926396Z 04:04:27 done
2023-02-23T04:04:27.1926753Z 
2023-02-23T04:04:27.1938873Z 04:04:27 Installing apt-fast for optimized installs...
2023-02-23T04:04:27.4080136Z --2023-02-23 04:04:27--  https://raw.githubusercontent.com/ilikenwf/apt-fast/master/apt-fast
2023-02-23T04:04:27.4100122Z Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 185.199.110.133, 185.199.111.133, 185.199.108.133, ...
2023-02-23T04:04:27.4154282Z Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|185.199.110.133|:443... connected.
2023-02-23T04:04:27.4340820Z HTTP request sent, awaiting response... 200 OK
2023-02-23T04:04:27.4341357Z Length: 22293 (22K) [text/plain]
2023-02-23T04:04:27.4342593Z Saving to: ‘/usr/local/sbin/apt-fast’
2023-02-23T04:04:27.4342979Z 
2023-02-23T04:04:27.4346610Z      0K .......... .......... .                               100% 49.2M=0s
2023-02-23T04:04:27.4346948Z 
2023-02-23T04:04:27.4389612Z 2023-02-23 04:04:27 (49.2 MB/s) - ‘/usr/local/sbin/apt-fast’ saved [22293/22293]
2023-02-23T04:04:27.4389934Z 04:04:27 done
2023-02-23T04:04:27.4390060Z 
2023-02-23T04:04:27.4411022Z 04:04:27 Updating APT package list...
2023-02-23T04:04:27.4441533Z 
2023-02-23T04:04:35.6507190Z 04:04:35 done
2023-02-23T04:04:35.6507682Z 
2023-02-23T04:04:35.6520948Z 04:04:35 Clean installing 5 packages...
2023-02-23T04:04:45.5248044Z 04:04:45 done
2023-02-23T04:04:45.5261864Z 04:04:45 Installation log written to /home/runner/cache-apt-pkgs/install.log
2023-02-23T04:04:45.5262307Z 
2023-02-23T04:04:45.5328500Z 04:04:45 Installed package list:
2023-02-23T04:04:45.5340817Z 04:04:45 - tk8.6-blt2.5:2.5.3+dfsg-4
2023-02-23T04:04:45.5351883Z 04:04:45 - blt:2.5.3+dfsg-4
2023-02-23T04:04:45.5367027Z 04:04:45 - git-restore-mtime:2019.11-1
2023-02-23T04:04:45.5378464Z 04:04:45 - libegl-mesa0:21.2.6-0ubuntu0.1~20.04.2
2023-02-23T04:04:45.5392348Z 04:04:45 - libegl1:1.3.2-1~ubuntu0.20.04.2
2023-02-23T04:04:45.5406398Z 04:04:45 - libglx-dev:1.3.2-1~ubuntu0.20.04.2
2023-02-23T04:04:45.5419414Z 04:04:45 - libgl-dev:1.3.2-1~ubuntu0.20.04.2
2023-02-23T04:04:45.5431678Z 04:04:45 - libegl-dev:1.3.2-1~ubuntu0.20.04.2
2023-02-23T04:04:45.5444330Z 04:04:45 - libgles1:1.3.2-1~ubuntu0.20.04.2
2023-02-23T04:04:45.5456563Z 04:04:45 - libgles2:1.3.2-1~ubuntu0.20.04.2
2023-02-23T04:04:45.5468997Z 04:04:45 - libgles-dev:1.3.2-1~ubuntu0.20.04.2
2023-02-23T04:04:45.5481713Z 04:04:45 - libopengl0:1.3.2-1~ubuntu0.20.04.2
2023-02-23T04:04:45.5493905Z 04:04:45 - libopengl-dev:1.3.2-1~ubuntu0.20.04.2
2023-02-23T04:04:45.5506185Z 04:04:45 - pandoc-data:2.5-3build2
2023-02-23T04:04:45.5518513Z 04:04:45 - pandoc:2.5-3build2
2023-02-23T04:04:45.5530823Z 04:04:45 - python3-tk:3.8.10-0ubuntu1~20.04
2023-02-23T04:04:45.5543220Z 04:04:45 - libglvnd-dev:1.3.2-1~ubuntu0.20.04.2
2023-02-23T04:04:45.5555537Z 04:04:45 - libgl1-mesa-dev:21.2.6-0ubuntu0.1~20.04.2
2023-02-23T04:04:45.5567793Z 04:04:45 - libosmesa6:21.2.6-0ubuntu0.1~20.04.2
2023-02-23T04:04:45.5582539Z 04:04:45 - libosmesa6-dev:21.2.6-0ubuntu0.1~20.04.2
2023-02-23T04:04:45.5582733Z 
2023-02-23T04:04:45.5613468Z 04:04:45 Caching 20 installed packages...
2023-02-23T04:04:45.5635013Z 04:04:45   * Caching tk8.6-blt2.5 to /home/runner/cache-apt-pkgs/tk8.6-blt2.5:2.5.3+dfsg-4.tar...
2023-02-23T04:04:45.6221798Z ##[error]Process completed with exit code 1.
@awalsh128
Copy link
Owner

Sorry to hear you are having trouble. I'll need to look at the diff > 1.2.4 to see what changes occurred.

My feeling is that tk8.6-blt2.5 itself is somehow involved. Can you enable debug and share your artifacts?

@akaszynski
Copy link
Author

In pyvista/pyvista#3964, I removed the tkinter requirement and enabled debug logging:
https://github.com/pyvista/pyvista/actions/runs/4378602732/jobs/7663542803?pr=3964

@awalsh128
Copy link
Owner

awalsh128 commented Mar 24, 2023

It looks like it is just showing standard output and the debug flag is false. Can you check to make sure the debug param is specified in the action and set to true.

Running the action install phase locally doesn't replicate this issue. I am going to add a regression test for this on the CI.

Also, FWIW I have rolled up a pre-release as v1.3.0 with other changes in it. It will reset the cache, so make sure to run the action a 2nd time if the 1st passes so both install and restore get tested.

@awalsh128
Copy link
Owner

Looks like the latest pre-release now addresses your issue. Can you confirm?

v1.2.4 - fails - https://github.com/awalsh128/cache-apt-pkgs-action-ci/actions/runs/4517518290
v1.3.0 - passes - https://github.com/awalsh128/cache-apt-pkgs-action-ci/actions/runs/4517431017

@tkoyama010
Copy link

tkoyama010 commented Mar 27, 2023

@awalsh128 Sorry it is still failing. What could we do for it?
pyvista/pyvista#4192

@awalsh128
Copy link
Owner

Tried adding some tests to replicate the issue but I can't seem to. The error is different than it was last time. Unfortunately this error is rather nebulous because there is no message. Was this ran with the debug: true?

@tkoyama010
Copy link

tkoyama010 commented Apr 3, 2023

@awalsh128 Yes, I set debug: "true" . Thanks a lot for your work.

@awalsh128
Copy link
Owner

No problem. I'm thinking we can take the action your product uses and trim it down to the minimal setup that causes the error. Suggestions on where to start? Build Doc stage?

@awalsh128
Copy link
Owner

Hi @tkoyama010, bumping this.

@awalsh128 awalsh128 added bug Something isn't working question Further information is requested labels Oct 30, 2023
@tkoyama010
Copy link

Thanks. We will try it.

@tkoyama010
Copy link

We are checking it in pyvista/pyvista#5151 .

@awalsh128
Copy link
Owner

Hi @tkoyama010, just reviewing tickets and wanted to check in on this.

@tkoyama010
Copy link

tkoyama010 commented Feb 13, 2024

Thanks for your mention. This is the newest dependabot PR. It seems that we still have the same issue.
pyvista/pyvista#5616

@awalsh128
Copy link
Owner

Okay finally found the root cause.

It is the addition of exit on error overriding the action script behavior.

env:
  ...
  SHELLOPTS: errexit:pipefail
  ...

I was able to recreate the problem with:

name: Isolated Dev Test
on:
  workflow_dispatch:
    inputs:
      debug:
        description: "Run in debug mode."
        type: boolean
        required: false
        default: true

env:
  DEBUG: ${{ github.event.inputs.debug || false }}
  SHELLOPTS: errexit:pipefail

jobs:
  regression_98_v2:
    runs-on: ubuntu-latest
    name: "Temporary test for PyVista doc cache failures (regression issue #98)."
    steps:
      - uses: actions/checkout@v3.1.0
      - uses: awalsh128/cache-apt-pkgs-action@dev
        with:
          packages: python3-tk
          version: ${{ github.run_id }}-${{ github.run_attempt }}-regression_98_v2
          debug: true

Then verify in the runs.

Explicitly turned this off in the library that uses it in f2fc6d1.

Can you verify by pointing your action to master?

@awalsh128 awalsh128 removed the question Further information is requested label Mar 3, 2024
This was referenced Mar 3, 2024
@tkoyama010
Copy link

Thanks. I'll try.

@tkoyama010
Copy link

tkoyama010 commented Mar 3, 2024

Can you verify by pointing your action to master?

@awalsh128 It is working! Thanks a lot! I cannot wait for the next release.

@awalsh128
Copy link
Owner

Great to hear! I'll roll this up in a new release of v1.4.2. Will update the issue when it is ready and your DependaBot update should clear it.

@awalsh128
Copy link
Owner

https://github.com/awalsh128/cache-apt-pkgs-action/releases/tag/v1.4.2 is now in prod.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants