Misc. bug: Vulkan docker build fails on github actions

[ITankForCAD]

Name and Version

Version 7134

Operating systems

Linux

Which llama.cpp modules do you know to be affected?

Other (Please specify in the next section)

Command line

Problem description & steps to reproduce

Hello again! Last week I opened an issue concerning an issue with the vulkan docker build. The issue was resolved with this commit, thank you btw :). The fix was to update the ubuntu version with which the dockerfile was built. Since that commit, docker builds of the vulkan image have been failing on github actions. A quick glance at the error logs from the first unsuccessful build shows that numpy fails to build, most likely due to a missing C compiler. Given that ubuntu 26.04 has not been released yet, there may be a conflict with the build essentials used in the dockerfile.

Paging @ericcurtin as it seems relevant.

First Bad Commit

The first bad commit is the one that introduced the fix to the issue I opened previously, commit bc809e9.

Relevant log output

#20 13.48   Downloading numpy-1.26.4.tar.gz (15.8 MB)
#20 13.61      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 15.8/15.8 MB 135.0 MB/s eta 0:00:00
#20 15.54   Installing build dependencies: started
#20 17.26   Installing build dependencies: finished with status 'done'
#20 17.26   Getting requirements to build wheel: started
#20 17.39   Getting requirements to build wheel: finished with status 'done'
#20 17.39   Installing backend dependencies: started
#20 18.38   Installing backend dependencies: finished with status 'done'
#20 18.38   Preparing metadata (pyproject.toml): started
#20 19.21   Preparing metadata (pyproject.toml): finished with status 'error'
#20 19.22   error: subprocess-exited-with-error
#20 19.22   
#20 19.22   × Preparing metadata (pyproject.toml) did not run successfully.
#20 19.22   │ exit code: 1
#20 19.22   ╰─> [20 lines of output]
#20 19.22       + /usr/bin/python3 /tmp/pip-install-p4xgmo1y/numpy_ba63b7775fd142ee9f0f697015a2f2d0/vendored-meson/meson/meson.py setup /tmp/pip-install-p4xgmo1y/numpy_ba63b7775fd142ee9f0f697015a2f2d0 /tmp/pip-install-p4xgmo1y/numpy_ba63b7775fd142ee9f0f697015a2f2d0/.mesonpy-19k9xnsx -Dbuildtype=release -Db_ndebug=if-release -Db_vscrt=md --native-file=/tmp/pip-install-p4xgmo1y/numpy_ba63b7775fd142ee9f0f697015a2f2d0/.mesonpy-19k9xnsx/meson-python-native-file.ini
#20 19.22       The Meson build system
#20 19.22       Version: 1.2.99
#20 19.22       Source dir: /tmp/pip-install-p4xgmo1y/numpy_ba63b7775fd142ee9f0f697015a2f2d0
#20 19.22       Build dir: /tmp/pip-install-p4xgmo1y/numpy_ba63b7775fd142ee9f0f697015a2f2d0/.mesonpy-19k9xnsx
#20 19.22       Build type: native build
#20 19.22       Project name: NumPy
#20 19.22       Project version: 1.26.4
#20 19.22       
#20 19.22       ../meson.build:1:0: ERROR: Unknown compiler(s): [['cc'], ['gcc'], ['clang'], ['nvc'], ['pgcc'], ['icc'], ['icx']]
#20 19.22       The following exception(s) were encountered:
#20 19.22       Running `cc --version` gave "[Errno 2] No such file or directory: 'cc'"
#20 19.22       Running `gcc --version` gave "[Errno 2] No such file or directory: 'gcc'"
#20 19.22       Running `clang --version` gave "[Errno 2] No such file or directory: 'clang'"
#20 19.22       Running `nvc --version` gave "[Errno 2] No such file or directory: 'nvc'"
#20 19.22       Running `pgcc --version` gave "[Errno 2] No such file or directory: 'pgcc'"
#20 19.22       Running `icc --version` gave "[Errno 2] No such file or directory: 'icc'"
#20 19.22       Running `icx --version` gave "[Errno 2] No such file or directory: 'icx'"
#20 19.22       
#20 19.22       A full log can be found at /tmp/pip-install-p4xgmo1y/numpy_ba63b7775fd142ee9f0f697015a2f2d0/.mesonpy-19k9xnsx/meson-logs/meson-log.txt
#20 19.22       [end of output]
#20 19.22   
#20 19.22   note: This error originates from a subprocess, and is likely not a problem with pip.
#20 19.22 error: metadata-generation-failed
#20 19.22 
#20 19.22 × Encountered error while generating package metadata.
#20 19.22 ╰─> See above for output.
#20 19.22 
#20 19.22 note: This is an issue with the package mentioned above, not pip.
#20 19.22 hint: See above for details.
#20 ERROR: process "/bin/sh -c apt-get update     && apt-get install -y     git     python3     python3-pip     python3-wheel     && pip install --break-system-packages --upgrade setuptools     && pip install --break-system-packages -r requirements.txt     && apt autoremove -y     && apt clean -y     && rm -rf /tmp/* /var/tmp/*     && find /var/cache/apt/archives /var/lib/apt/lists -not -name lock -type f -delete     && find /var/cache -type f -delete" did not complete successfully: exit code: 1
------
 > [full 3/3] RUN apt-get update     && apt-get install -y     git     python3     python3-pip     python3-wheel     && pip install --break-system-packages --upgrade setuptools     && pip install --break-system-packages -r requirements.txt     && apt autoremove -y     && apt clean -y     && rm -rf /tmp/* /var/tmp/*     && find /var/cache/apt/archives /var/lib/apt/lists -not -name lock -type f -delete     && find /var/cache -type f -delete:
19.22       [end of output]
19.22   
19.22   note: This error originates from a subprocess, and is likely not a problem with pip.
19.22 error: metadata-generation-failed
19.22 
19.22 × Encountered error while generating package metadata.
19.22 ╰─> See above for output.
19.22 
19.22 note: This is an issue with the package mentioned above, not pip.
19.22 hint: See above for details.
------
vulkan.Dockerfile:51
--------------------
  50 |     
  51 | >>> RUN apt-get update \
  52 | >>>     && apt-get install -y \
  53 | >>>     git \
  54 | >>>     python3 \
  55 | >>>     python3-pip \
  56 | >>>     python3-wheel \
  57 | >>>     && pip install --break-system-packages --upgrade setuptools \
  58 | >>>     && pip install --break-system-packages -r requirements.txt \
  59 | >>>     && apt autoremove -y \
  60 | >>>     && apt clean -y \
  61 | >>>     && rm -rf /tmp/* /var/tmp/* \
  62 | >>>     && find /var/cache/apt/archives /var/lib/apt/lists -not -name lock -type f -delete \
  63 | >>>     && find /var/cache -type f -delete
  64 |     
--------------------
ERROR: failed to build: failed to solve: process "/bin/sh -c apt-get update     && apt-get install -y     git     python3     python3-pip     python3-wheel     && pip install --break-system-packages --upgrade setuptools     && pip install --break-system-packages -r requirements.txt     && apt autoremove -y     && apt clean -y     && rm -rf /tmp/* /var/tmp/*     && find /var/cache/apt/archives /var/lib/apt/lists -not -name lock -type f -delete     && find /var/cache -type f -delete" did not complete successfully: exit code: 1
Reference
Check build summary support
Error: buildx failed with: ERROR: failed to build: failed to solve: process "/bin/sh -c apt-get update     && apt-get install -y     git     python3     python3-pip     python3-wheel     && pip install --break-system-packages --upgrade setuptools     && pip install --break-system-packages -r requirements.txt     && apt autoremove -y     && apt clean -y     && rm -rf /tmp/* /var/tmp/*     && find /var/cache/apt/archives /var/lib/apt/lists -not -name lock -type f -delete     && find /var/cache -type f -delete" did not complete successfully: exit code: 1

[ericcurtin]

Giving copilot a go at this...

[ITankForCAD]

Upon further investigation, it seems that meson is failing because it can't find a C compiler. However, C compilers are available and working fine because llama.cpp binaries build correctly. Maybe this narrows down the issue a bit.