docker-php-ext-install with buildx fails

[trickert76]

I've a strange problem with the combination of docker-php-ext-install and buildx. When I run

docker run --rm --privileged multiarch/qemu-user-static --reset -p yes
docker buildx create --driver docker-container --use
docker buildx inspect --bootstrap
docker buildx ls
docker buildx build \
  --platform linux/amd64,linux/arm64 \
  --pull \
  --no-cache \
  --push \
  ./

with a Dockerfile for PHP 7.4 or PHP 8.2 (I think, the version is not important), like

FROM php:8.2-apache
....
RUN apt-get update --allow-releaseinfo-change && apt-get dist-upgrade -y && \
    apt-get install -y \
      catdoc \
      cron \
      curl \
      exiv2 \
      git \
      imagemagick \
      jq \
      libcap2-bin \
      libcurl4 \
      libcurl4-openssl-dev \
      libfreetype6-dev \
      libicu-dev \
      libjpeg62-turbo-dev \
      libldap2-dev \
      libmcrypt-dev \
      libmemcached-dev \
      libpng-dev \
      libssl-dev \
      libxml2-dev \
      libzip-dev \
      mariadb-client \
      msmtp \
      msmtp-mta \
      pngquant \
      poppler-utils \
      ssl-cert \
      tar \
      tesseract-ocr \
      tesseract-ocr-eng \
      tnef \
      unzip \
      zip \
      zlib1g-dev \
      zlib1g
RUN docker-php-ext-configure gd --with-freetype --with-jpeg && \
    docker-php-ext-configure ldap

RUN docker-php-ext-install soap pdo pdo_mysql calendar gd sysvshm sysvsem sysvmsg ldap opcache intl pcntl zip bcmath 
...

I'm getting always a compile error on the "other architecture". When I run buildx on an Intel system, I'm getting an error on build for ARM and when I run it on a M1, I'm getting an error for AMD64. When I run a normal docker build (without x), it always works. Also, sometimes it works on both architectures at the same time. But it feels a little bit like "don't touch a running system" then, because the next run (clearing all caches) breakes again.

The error itself differs from time to time. This time it's

#0 374.3 
#0 374.4 + strip --strip-all modules/sysvshm.so
#0 374.8 Installing shared extensions:     /usr/local/lib/php/extensions/no-debug-non-zts-20190902/
#0 375.6 find . -name \*.gcno -o -name \*.gcda | xargs rm -f
#0 375.7 find . -name \*.lo -o -name \*.o | xargs rm -f
#0 375.8 find . -name \*.la -o -name \*.a | xargs rm -f
#0 375.8 find . -name \*.so | xargs rm -f
#0 375.9 find . -name .libs -a -type d|xargs rm -rf
#0 376.0 rm -f libphp.la      modules/* libs/*
#0 376.4 Configuring for:
#0 376.4 PHP Api Version:         20190902
#0 376.4 Zend Module Api No:      20190902
#0 376.4 Zend Extension Api No:   320190902
#0 381.9 checking for grep that handles long lines and -e... /bin/grep
#0 381.9 checking for egrep... /bin/grep -E
#0 381.9 checking for a sed that does not truncate output... /bin/sed
#0 382.4 checking for pkg-config... /usr/bin/pkg-config
#0 382.4 checking pkg-config is at least version 0.9.0... yes
#0 382.4 checking for cc... cc
#0 382.7 checking whether the C compiler works... yes
#0 383.2 checking for C compiler default output file name... a.out
#0 383.2 checking for suffix of executables... 
#0 383.7 checking whether we are cross compiling... configure: error: in `/usr/src/php/ext/sysvsem':
#0 384.2 configure: error: cannot run C compiled programs.
#0 384.2 If you meant to cross compile, use `--host'.
#0 384.2 See `config.log' for more details

or

#0 24.23 
#0 24.23 creating libtool
#0 24.47 appending configuration tag "CXX" to libtool
#0 25.23 configure: patching config.h.in
#0 25.28 configure: creating ./config.status
#0 26.10 config.status: creating config.h
#0 26.55 /bin/bash /usr/src/php/ext/soap/libtool --mode=compile cc -I. -I/usr/src/php/ext/soap -I/usr/src/php/ext/soap/include -I/usr/src/php/ext/soap/main -I/usr/src/php/ext/soap -I/usr/local/include/php -I/usr/local/include/php/main -I/usr/local/include/php/TSRM -I/usr/local/include/php/Zend -I/usr/local/include/php/ext -I/usr/local/include/php/ext/date/lib -I/usr/include/libxml2  -fstack-protector-strong -fpic -fpie -O2 -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DHAVE_CONFIG_H  -fstack-protector-strong -fpic -fpie -O2 -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE   -DZEND_ENABLE_STATIC_TSRMLS_CACHE=1 -DZEND_COMPILE_DL_EXT=1 -c /usr/src/php/ext/soap/soap.c -o soap.lo  -MMD -MF soap.dep -MT soap.lo
#0 28.14 mkdir .libs
#0 28.18  cc -I. -I/usr/src/php/ext/soap -I/usr/src/php/ext/soap/include -I/usr/src/php/ext/soap/main -I/usr/src/php/ext/soap -I/usr/local/include/php -I/usr/local/include/php/main -I/usr/local/include/php/TSRM -I/usr/local/include/php/Zend -I/usr/local/include/php/ext -I/usr/local/include/php/ext/date/lib -I/usr/include/libxml2 -fstack-protector-strong -fpic -fpie -O2 -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DHAVE_CONFIG_H -fstack-protector-strong -fpic -fpie -O2 -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -DZEND_ENABLE_STATIC_TSRMLS_CACHE=1 -DZEND_COMPILE_DL_EXT=1 -c /usr/src/php/ext/soap/soap.c -MMD -MF soap.dep -MT soap.lo  -fPIC -DPIC -o .libs/soap.o
#0 39.04 /bin/bash /usr/src/php/ext/soap/libtool --mode=compile cc -I. -I/usr/src/php/ext/soap -I/usr/src/php/ext/soap/include -I/usr/src/php/ext/soap/main -I/usr/src/php/ext/soap -I/usr/local/include/php -I/usr/local/include/php/main -I/usr/local/include/php/TSRM -I/usr/local/include/php/Zend -I/usr/local/include/php/ext -I/usr/local/include/php/ext/date/lib -I/usr/include/libxml2  -fstack-protector-strong -fpic -fpie -O2 -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DHAVE_CONFIG_H  -fstack-protector-strong -fpic -fpie -O2 -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE   -DZEND_ENABLE_STATIC_TSRMLS_CACHE=1 -DZEND_COMPILE_DL_EXT=1 -c /usr/src/php/ext/soap/php_encoding.c -o php_encoding.lo  -MMD -MF php_encoding.dep -MT php_encoding.lo
#0 40.59  cc -I. -I/usr/src/php/ext/soap -I/usr/src/php/ext/soap/include -I/usr/src/php/ext/soap/main -I/usr/src/php/ext/soap -I/usr/local/include/php -I/usr/local/include/php/main -I/usr/local/include/php/TSRM -I/usr/local/include/php/Zend -I/usr/local/include/php/ext -I/usr/local/include/php/ext/date/lib -I/usr/include/libxml2 -fstack-protector-strong -fpic -fpie -O2 -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DHAVE_CONFIG_H -fstack-protector-strong -fpic -fpie -O2 -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -DZEND_ENABLE_STATIC_TSRMLS_CACHE=1 -DZEND_COMPILE_DL_EXT=1 -c /usr/src/php/ext/soap/php_encoding.c -MMD -MF php_encoding.dep -MT php_encoding.lo  -fPIC -DPIC -o .libs/php_encoding.o
#0 46.28 /usr/src/php/ext/soap/php_encoding.c: In function 'to_xml_array':
#0 46.28 /usr/src/php/ext/soap/php_encoding.c:2389:37: warning: 'strcmp' reading 1 or more bytes from a region of size 0 [-Wstringop-overread]
#0 46.28  2389 |                                 if (strcmp(ZSTR_VAL(array_type.s),"xsd:anyType") == 0) {
#0 46.28       |                                     ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
#0 48.38 /bin/bash /usr/src/php/ext/soap/libtool --mode=compile cc -I. -I/usr/src/php/ext/soap -I/usr/src/php/ext/soap/include -I/usr/src/php/ext/soap/main -I/usr/src/php/ext/soap -I/usr/local/include/php -I/usr/local/include/php/main -I/usr/local/include/php/TSRM -I/usr/local/include/php/Zend -I/usr/local/include/php/ext -I/usr/local/include/php/ext/date/lib -I/usr/include/libxml2  -fstack-protector-strong -fpic -fpie -O2 -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DHAVE_CONFIG_H  -fstack-protector-strong -fpic -fpie -O2 -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE   -DZEND_ENABLE_STATIC_TSRMLS_CACHE=1 -DZEND_COMPILE_DL_EXT=1 -c /usr/src/php/ext/soap/php_http.c -o php_http.lo  -MMD -MF php_http.dep -MT php_http.lo
#0 49.94  cc -I. -I/usr/src/php/ext/soap -I/usr/src/php/ext/soap/include -I/usr/src/php/ext/soap/main -I/usr/src/php/ext/soap -I/usr/local/include/php -I/usr/local/include/php/main -I/usr/local/include/php/TSRM -I/usr/local/include/php/Zend -I/usr/local/include/php/ext -I/usr/local/include/php/ext/date/lib -I/usr/include/libxml2 -fstack-protector-strong -fpic -fpie -O2 -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DHAVE_CONFIG_H -fstack-protector-strong -fpic -fpie -O2 -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -DZEND_ENABLE_STATIC_TSRMLS_CACHE=1 -DZEND_COMPILE_DL_EXT=1 -c /usr/src/php/ext/soap/php_http.c -MMD -MF php_http.dep -MT php_http.lo  -fPIC -DPIC -o .libs/php_http.o
#0 49.95 /usr/src/php/ext/soap/libtool: line 1330:  4339 Segmentation fault      cc -I. -I/usr/src/php/ext/soap -I/usr/src/php/ext/soap/include -I/usr/src/php/ext/soap/main -I/usr/src/php/ext/soap -I/usr/local/include/php -I/usr/local/include/php/main -I/usr/local/include/php/TSRM -I/usr/local/include/php/Zend -I/usr/local/include/php/ext -I/usr/local/include/php/ext/date/lib -I/usr/include/libxml2 -fstack-protector-strong -fpic -fpie -O2 -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DHAVE_CONFIG_H -fstack-protector-strong -fpic -fpie -O2 -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -DZEND_ENABLE_STATIC_TSRMLS_CACHE=1 -DZEND_COMPILE_DL_EXT=1 -c /usr/src/php/ext/soap/php_http.c -MMD -MF php_http.dep -MT php_http.lo -fPIC -DPIC -o .libs/php_http.o
#0 49.95 make: *** [Makefile:216: php_http.lo] Error 1

Thats completely strange to me. I don't have an idea, what to do. I'm using different docker version, this one, I tried 23.0.5 and/or 24.0.3

[tianon]

I'm getting always a compile error on the "other architecture". When I run buildx on an Intel system, I'm getting an error on build for ARM and when I run it on a M1, I'm getting an error for AMD64.

This bit makes me think it's most likely an issue with the (transparent) QEMU emulation that enables building both on non-native architectures. I would suggest looking into buildx's "multi-node" support (https://docs.docker.com/engine/reference/commandline/buildx_create/#append) so you can add each native node to the same "builder" and have them build natively instead.

[trickert76]

Thanks, I‘m sure, that will work, when my build environment would support both platforms. But the ARM is my local machine and not a node. I think, this is a combination of gcc and qemu and maybe not a problem of PHP build scripts. Maybe someone else also had the problems. Especially because it isnt 100% reproducable, makes it difficult to find the issue. Maybe I check the buildx issue list for a similar problem. Thanks. Am 12.07.2023 um 00:24 schrieb Tianon Gravi ***@***.***>: I'm getting always a compile error on the "other architecture". When I run buildx on an Intel system, I'm getting an error on build for ARM and when I run it on a M1, I'm getting an error for AMD64. This bit makes me think it's most likely an issue with the (transparent) QEMU emulation that enables building both on non-native architectures. I would suggest looking into buildx's "multi-node" support (https://docs.docker.com/engine/reference/commandline/buildx_create/#append) so you can add each native node to the same "builder" and have them build natively instead. —Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: ***@***.***>

[gj-projectminttech]

Try turning off rosetta emulation in docker. It's slower, but it might work for you.

[tianon]

This isn't something we can fix in the Docker image (it's going to require environment or emulator changes). Building on cloud resources is a pretty straightforward workaround for those affected.

[99hops]

Hello hello, may I jump here, I get absolutely random (modules) segfaults using dind

- docker buildx create --use
- docker buildx inspect --bootstrap
- DOCKER_BUILDKIT=1 docker buildx build --platform linux/amd64,linux/arm64 --target dev -t $CI_REGISTRY_IMAGE:dev --push .

62.75 /tmp/pear/temp/pear-build-defaultuserb5AuCc/redis-6.1.0/libtool: line 1330:  3957 Segmentation fault      (core dumped) cc -I. -I/tmp/pear/temp/redis -I/tmp/pear/temp/pear-build-defaultuserb5AuCc/redis-6.1.0/include -I/tmp/pear/temp/pear-build-defaultuserb5AuCc/redis-6.1.0/main -I/tmp/pear/temp/redis -I/usr/local/include/php -I/usr/local/include/php/main -I/usr/local/include/php/TSRM -I/usr/local/include/php/Zend -I/usr/local/include/php/ext -I/usr/local/include/php/ext/date/lib -I/usr/local/include/php/ext -DHAVE_CONFIG_H -g -O2 -D_GNU_SOURCE -DZEND_COMPILE_DL_EXT=1 -c /tmp/pear/temp/redis/redis_commands.c -MMD -MF redis_commands.dep -MT redis_commands.lo -fPIC -DPIC -o .libs/redis_commands.o
62.75 make: *** [Makefile:213: redis_commands.lo] Error 1
62.76 ERROR: `make' failed

I can build nodejs image on the same nodes with no problem so I am not exactly sure what is wrong apart from it's impossible to build php:8.3.13-fpm-bookworm this way?
@trickert76 were you able to resolve this somehow?

Please advice 🐱

[yosifkit]

@99hops, #1424 (comment) We have often seen strange errors and segfaults like this that fail in qemu user-mode emulation (the default used by buildx) but build fine when built on the native architecture. The answer is to not use qemu user-mode emulation for that build. Build on a host that is the architecture that you want to target. You can attempt with a full qemu VM, i.e., system mode emulation and that usually works better. You can add those arch-specific hosts to a buildx "builder" and can then do the same docker buildx build targeting that multi node builder.