PHP: pecl install is still slow and still produces massive binaries
#34278
Assignees
Labels
Comments
|
I confirm. The problem is relevant. I get 30 minutes to install the extension. Exactly because of this problem, I’m already thinking about rewriting my application into another programming language, just so as not to encounter this extension again. |
|
i confirm too. Install grpc with pecl takes more then 30 Minutes. in Docker environment. So i thinks its not only with pecl. during build i can see that the most time is used by building all the third_party extensions the library is really big i think: |
|
setting ENV MAKEFLAGS=" -j 4" with pecl speeds it up to about 15 Minutes build time |
|
You can strip the debug symbols using I can also confirm we are dealing with 30 min. build times. However, we are extending |
|
I would also like to say we are experiencing 30 minute build times when installing into Docker and running on Bitbucket Pipelines. Current Dockerfile uses the commands: |
|
I have the same issue here, the build process takes ~2 hours and produces a 235MB binary. I am using API Platform 2.7. Counter measures I used are in the following Dockerfile (I followed solutions in previous comments): ARG PHP_VERSION=8.2
FROM php:${PHP_VERSION}-fpm-alpine
RUN set -eux; \
apk add --no-cache --virtual .build-deps \
$PHPIZE_DEPS \
zlib-dev \
linux-headers \
;
# isolate gRPC as the build times are problematic, see https://github.com/grpc/grpc/issues/34278
RUN set -eux; \
MAKEFLAGS="-j $(nproc)" pecl install \
grpc \
;
RUN set -eux; \
apk add --no-cache \
libstdc++ \
;
# strip php extensions to decrease container size
RUN set -eux; \
find "$(php-config --extension-dir)" -name '*.so' -type f -exec strip --strip-all {} ';' \
;
RUN set -eux; \
pecl clear-cache \
; \
docker-php-ext-enable \
grpc \
;
RUN set -eux; \
runDeps="$( \
scanelf --needed --nobanner --format '%n#p' --recursive /usr/local/lib/php/extensions \
| tr ',' '\n' \
| sort -u \
| awk 'system("[ -e /usr/local/lib/" $1 " ]") == 0 { next } { print "so:" $1 }' \
)" \
; \
apk add --no-cache --virtual .api-phpexts-rundeps $runDeps \
; \
apk del .build-deps |
This was referenced Dec 22, 2023
|
If you are using alpine with Docker. Checkout this: It installs in few seconds |
It worked nicely! ❤️ @shyim Do you know of any way to work with a multi-stage build? I'm building gRPC in one stage and copying the binary result, but I'm facing an issue with FROM php:8.2-fpm-alpine AS php-ext
# Install packages and remove default server definition
RUN apk update && apk add --no-cache --virtual \
build-essentials \
linux-headers \
curl \
git \
grep \
build-base \
imagemagick-dev \
pcre-dev \
libtool \
make \
autoconf \
g++ \
libpq-dev \
icu-dev \
icu-libs \
zlib-dev \
automake \
libzip-dev \
libpng-dev \
libwebp-dev \
libjpeg-turbo-dev \
freetype-dev \
libxml2-dev
RUN apk add --no-cache git grpc-cpp grpc-dev $PHPIZE_DEPS && \
git clone --depth 1 -b v1.59.4 https://github.com/grpc/grpc /tmp/grpc && \
cd /tmp/grpc/src/php/ext/grpc && \
phpize && \
./configure && \
make && \
make install && \
rm -rf /tmp/grpc && \
apk del --no-cache git grpc-dev $PHPIZE_DEPS
RUN docker-php-source extract \
# ext-opache
&& docker-php-ext-enable opcache \
# ext-igbinary
&& mkdir -p /usr/src/php/ext/igbinary \
&& curl -fsSL https://github.com/igbinary/igbinary/archive/refs/tags/3.2.15.tar.gz | tar xvz -C /usr/src/php/ext/igbinary --strip 1 \
&& docker-php-ext-install igbinary \
# ext-redis
&& mkdir -p /usr/src/php/ext/redis \
&& curl -fsSL https://github.com/phpredis/phpredis/archive/refs/tags/6.0.2.tar.gz | tar xvz -C /usr/src/php/ext/redis --strip 1 \
&& docker-php-ext-configure redis --enable-redis-igbinary \
&& docker-php-ext-install redis \
# ext-apcu
&& mkdir -p /usr/src/php/ext/apcu \
&& curl -fsSL https://github.com/krakjoe/apcu/archive/refs/tags/v5.1.23.tar.gz | tar xvz -C /usr/src/php/ext/apcu --strip 1 \
&& docker-php-ext-install apcu \
# ext-bcmath, ext-sockets
&& docker-php-ext-install bcmath sockets \
## cleanup
&& docker-php-source delete
RUN docker-php-source extract \
&& git clone --branch 1.17.2 --depth 1 https://github.com/mongodb/mongo-php-driver.git /usr/src/php/ext/mongodb \
&& cd /usr/src/php/ext/mongodb && git submodule update --init \
&& docker-php-ext-install mongodb
RUN docker-php-ext-configure gd --enable-gd --with-freetype --with-jpeg --with-webp \
&& docker-php-ext-install gd
RUN docker-php-ext-configure pgsql -with-pgsql=/usr/local/pgsql \
&& docker-php-ext-install pdo pdo_pgsql pgsql
RUN docker-php-ext-install xml soap exif
RUN pecl install imagick \
&& docker-php-ext-enable imagick
FROM php:8.2-fpm-alpine
WORKDIR /var/www/html
ARG USERNAME=pilot
ARG USER_UID=1000
ARG USER_GID=$USER_UID
# Install packages and remove default server definition
RUN apk update && apk add --no-cache --virtual \
curl \
git \
supervisor \
openssh \
nginx
# Create system user to run Composer and Artisan Commands
RUN addgroup -g $USER_GID $USERNAME \
&& adduser -u $USER_UID -G $USERNAME -s /bin/bash -h /home/$USERNAME -D $USERNAME
RUN mkdir -p /home/$USERNAME/.composer && \
chown -R $USERNAME:$USERNAME /home/$USERNAME
# Setup document root
RUN mkdir -p /var/www/html \
&& mkdir -p /var/lib/nginx \
&& mkdir -p /var/lib/nginx/tmp \
&& mkdir -p /var/log/nginx
# Make sure files/folders needed by the processes are accessable when they run under the nobody user
RUN chown -R $USERNAME:$USERNAME /var/www/html \
&& chown -R $USERNAME:$USERNAME /run \
&& chown -R $USERNAME:$USERNAME /var/lib/nginx \
&& chown -R $USERNAME:$USERNAME /var/log/nginx
# Get latest Composer
COPY --from=composer:latest /usr/bin/composer /usr/bin/composer
# Copy grpc extension from php-ext stage
COPY --from=php-ext /usr/local/lib/php/extensions/no-debug-non-zts-20220829/grpc.so /usr/local/lib/php/extensions/no-debug-non-zts-20220829/grpc.so
COPY --from=php-ext /usr/local/lib/php/extensions/no-debug-non-zts-20220829/apcu.so /usr/local/lib/php/extensions/no-debug-non-zts-20220829/apcu.so
COPY --from=php-ext /usr/local/lib/php/extensions/no-debug-non-zts-20220829/igbinary.so /usr/local/lib/php/extensions/no-debug-non-zts-20220829/igbinary.so
COPY --from=php-ext /usr/local/lib/php/extensions/no-debug-non-zts-20220829/opcache.so /usr/local/lib/php/extensions/no-debug-non-zts-20220829/opcache.so
COPY --from=php-ext /usr/local/lib/php/extensions/no-debug-non-zts-20220829/redis.so /usr/local/lib/php/extensions/no-debug-non-zts-20220829/redis.so
COPY --from=php-ext /usr/local/lib/php/extensions/no-debug-non-zts-20220829/sockets.so /usr/local/lib/php/extensions/no-debug-non-zts-20220829/sockets.so
COPY --from=php-ext /usr/local/lib/php/extensions/no-debug-non-zts-20220829/sodium.so /usr/local/lib/php/extensions/no-debug-non-zts-20220829/sodium.so
COPY --from=php-ext /usr/local/lib/php/extensions/no-debug-non-zts-20220829/mongodb.so /usr/local/lib/php/extensions/no-debug-non-zts-20220829/mongodb.so
# Enable grpc extension
RUN docker-php-ext-enable grpc apcu igbinary opcache redis sockets sodium mongodb
# Configure nginx
COPY config/nginx.conf /etc/nginx/nginx.conf
# Configure PHP-FPM
COPY config/fpm-pool.conf /etc/php8/php-fpm.d/www.conf
COPY config/php.ini "$PHP_INI_DIR/php.ini"
# Configure supervisord
COPY config/supervisord.conf /etc/supervisord.conf
# Add application
COPY --chown=$USERNAME:$USERNAME src/ /var/www/html/
# Switch to use a non-root user from here on
USER $USERNAME
# Expose the port nginx is reachable on
EXPOSE 8080
# Let supervisord start nginx & php-fpm
CMD ["/usr/bin/supervisord", "-c", "/etc/supervisord.conf"]
# Configure a healthcheck to validate that everything is up&running
HEALTHCHECK --timeout=10s CMD curl --silent --fail http://127.0.0.1:8080/fpm-ping |
|
I would try to install |
Also had the same errors on build - felt like it was all to good to be true.. did you figure out a fix? |
This is what my Dockerfile looks like. https://gist.github.com/luishgp/873a9b4759457169b6c6cd7aaea19707 Hope it helps you |
|
@luishgp I did try that, but this morning, I figured it out. I removed grpc-dev from |
I'd guess that unless you're using that in a multi-stage build and copying things over, the final image's layers sum up to the layer size from that step alone + whatever size differences before and after it... If you want the image pullers to have a "good time", you'll either need to split it in a multi-stage build and include the specific files via @grassdionera I think I may be doing something wrong, on my part... I've tried |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
What version of gRPC and what language are you using?
What operating system (Linux, Windows,...) and version?
What runtime / compiler are you using (e.g. python version or version of gcc)
What did you do?
Please provide either 1) A unit test for reproducing the bug or 2) Specific steps for us to follow to reproduce the bug. If there’s not enough information to debug the problem, gRPC team may close the issue at their discretion. You’re welcome to re-open the issue once you have a reproduction.
time sudo pecl install grpcWhat did you expect to see?
The extension install in a reasonable timeframe and at a reasonable size
What did you see instead?
The extension install takes on the order of 30 minutes, and produces a ~50MB binary that is ~10x larger than intended due to the inclusion of debug symbols (which should not be present in builds created or distributed this way).
Make sure you include information that can help us debug (full error message, exception listing, stack trace, logs).
See TROUBLESHOOTING.md for how to diagnose problems better.
Anything else we should know about your project / environment?
Please see the existing discussion at #23626.
I'm opening this as a new Issue because the previous one was closed seemingly by accident (and I lack the permissions to reopen it). If that Issue can be reopened, this one can be closed as a duplicate. Until then, the problem risks not being tracked or mitigated.
The text was updated successfully, but these errors were encountered: