Build libvips with poppler from source #1749
Comments
|
Hello @asterikx, I can't see anything obviously wrong. I'll try building your dockerfile. |
|
libvips uses the poppler-glib interface, which isn't being built. You'll need to enable it with something like: I noticed you are missing libexif -- it's needed to get metadata from JPEG files. I imagine the one in yum would be OK. I would add orc as well -- you'll see a dramatic speedup for things like convolution. I'd build libvips with |
|
Hi @jcupitt, thank you so much! The version of CMake that comes with the image is too old and building takes very long, unfortunately ... Off-topic: I'm building poppler version This issue suggests that my version of It's probably an issue with picking the correct version of libpng ( |
Thank you! Sorry, I think I'm lacking a bit of general knowledge in "system-level" programming.
Thanks for the tips! Would you recommend installing I'm also not sure if I only need the |
|
We're staying 0.89 for now in the win32 build, if that's an option for you. |
|
Yes, orc will help resize speed too. You don't need the |
|
Oh, you never need |
|
I'm pressing Comment too quickly.
Static libraries are very simple bundles of code that get copied into your program when you make an executable. They are only used during compilation and just by the linker. They have a range of problems (tricky to update, tricky to link to system services, inflexible) and have mostly vanished. Dynamic libraries are used both at compile time and at runtime. Rather than copying code into your executable, the compiler just leaves a reference to the library. At run-time, the dynamic linker automatically finds and pull in the |
|
I understand now. Thank you for this very good explanation 🥇
Are these controlled using flags like (because I'm unsure when I need those and when not) I'm still facing issues with the poppler build though. It does not recognize cairo correctly. Dockerfile snippet# Install Poppler (http://www.linuxfromscratch.org/blfs/view/svn/general/poppler.html)
#
ENV POPPLER_VERSION=0.89.0
ENV POPPLER_BUILD_DIR=${BUILD_DIR}/poppler
RUN set -Eeuxo pipefail \
&& mkdir -p ${POPPLER_BUILD_DIR}/build \
&& curl -L https://poppler.freedesktop.org/poppler-${POPPLER_VERSION}.tar.xz \
| tar xJC ${POPPLER_BUILD_DIR} --strip-components=1
WORKDIR ${POPPLER_BUILD_DIR}/build/
RUN set -Eeuxo pipefail \
&& cmake .. \
-DCMAKE_BUILD_TYPE=Release \
-DCMAKE_INSTALL_PREFIX=${INSTALL_DIR} \
-DENABLE_UNSTABLE_API_ABI_HEADERS=ON \
-DENABLE_ZLIB=ON \
-DENABLE_LIBTIFF=ON \
-DENABLE_LIBPNG=ON \
-DENABLE_GLIB=ON \
-DENABLE_CMS='lcms2' \
-DENABLE_LIBOPENJPEG='openjpeg2' \
-DENABLE_DCTDECODER='libjpeg' \
-DENABLE_SPLASH=OFF \
-DENABLE_CPP=OFF \
&& make \
&& make installpoppler configuration output |
|
You don't need to generate executables like pdftocairo, I'd just disable them in the cmake config for poppler. |
|
Yes, the library path is set in three ways:
It's actually more complex than this, since libraries can be versioned, but that's the general idea. |
|
Perfect, thanks. I just realized that libvips requires Poppler OR Cairo. So having both is probably not necessary. I needed to add the compiler flag Unfortunately, libvips did still not pickup Poppler. Only the I had a look into Poppler's Poppler outputIn my case, the installed version of GLib was too old. Poppler requests version So I had to install GLib from source too. After that libvips did finally build with Poppler support 🎉 Dockerfile (for future reference)FROM lambci/lambda:build-go1.x AS compile-image
# See here for more build examples: https://github.com/stechstudio/libvips-lambda/tree/master/build/dependencies
# https://github.com/jeylabs/aws-lambda-poppler-layer
# https://github.com/pjfoley/poppler-for-lambda
# SHELL ["/bin/bash", "-c"]
ENV BUILD_DIR="/tmp/build"
ENV INSTALL_DIR="/opt"
# Create all necessary build directories
#
RUN set -Eeuxo pipefail \
&& mkdir -p ${BUILD_DIR}/{etc,bin,doc,include,lib,lib64,libexec,sbin,share}
# Install Development Tools
#
WORKDIR /tmp
RUN set -Eeuxo pipefail \
&& yum -y update \
&& yum -y install \
gcc72-c++ \
# libuuid is required by Fontconfig
libuuid-devel \
nasm \
ninja-build \
&& yum -y clean all
RUN pip3 install meson
# Set GCC to 7.2.1-2 (default is 4.8.5-28 on lambci/lambda:build-go1.x image)
RUN update-alternatives --set gcc /usr/bin/gcc72
# Install CMake (http://www.linuxfromscratch.org/blfs/view/svn/general/cmake.html)
#
# Pre-installed on Amazon Linux: 2.8.12.2
# Required by: Fontconfig (Poppler)
#
ENV CMAKE3_VERSION=3.18.0
ENV CMAKE3_BUILD_DIR=${BUILD_DIR}/cmake3
RUN set -Eeuxo pipefail \
&& mkdir -p ${CMAKE3_BUILD_DIR} \
&& curl -L https://github.com/Kitware/CMake/releases/download/v${CMAKE3_VERSION}/cmake-${CMAKE3_VERSION}.tar.gz \
| tar xzC ${CMAKE3_BUILD_DIR} --strip-components=1 \
&& curl -L http://www.linuxfromscratch.org/patches/blfs/svn/cmake-${CMAKE3_VERSION}-regression_fix-1.patch -o ${CMAKE3_BUILD_DIR}/cmake-${CMAKE3_VERSION}-regression_fix-1.patch
WORKDIR ${CMAKE3_BUILD_DIR}/
RUN set -Eeuxo pipefail \
&& patch -Np1 -i cmake-${CMAKE3_VERSION}-regression_fix-1.patch \
&& sed -i '/"lib64"/s/64//' Modules/GNUInstallDirs.cmake \
&& ./bootstrap \
# --prefix=/usr/local \
--parallel=4 \
&& make V=0 \
&& make install
# Configure Default Compiler Variables
#
ENV PATH="${INSTALL_DIR}/bin:${PATH}" \
LD_LIBRARY_PATH="${INSTALL_DIR}/lib64:${INSTALL_DIR}/lib:${LD_LIBRARY_PATH}" \
PKG_CONFIG_PATH="${INSTALL_DIR}/lib64/pkgconfig:${INSTALL_DIR}/lib/pkgconfig"
# Install GLib (http://www.linuxfromscratch.org/blfs/view/svn/general/cmake.html)
#
# Pre-installed on Amazon Linux: 2.36.3
# Required by: Poppler
# Note: Amazon Linux has GLib 2.36.3 but Poppler requires >=2.41.0
#
ENV GLIB_VERSION=2.64.4
ENV GLIB_MAJOR=2.64
ENV GLIB_BUILD_DIR=${BUILD_DIR}/glib
RUN set -Eeuxo pipefail \
&& mkdir -p ${GLIB_BUILD_DIR} \
&& curl -L http://ftp.gnome.org/pub/gnome/sources/glib/${GLIB_MAJOR}/glib-${GLIB_VERSION}.tar.xz \
| tar xJC ${GLIB_BUILD_DIR} --strip-components=1
WORKDIR ${GLIB_BUILD_DIR}
RUN set -Eeuxo pipefail \
&& mkdir build \
&& cd build \
&& meson \
--prefix=${INSTALL_DIR} \
-Dselinux=disabled \
&& ninja \
&& ninja install
# Install Libpng (http://www.linuxfromscratch.org/blfs/view/svn/general/openjpeg2.html)
#
# Pre-installed on Amazon Linux: 1.2.49
# Required by: Cairo (Poppler)
# Recommended dependency of: Poppler, FreeType (Poppler)
# Optional dependency of: libvips
#
ENV LIBPNG_VERSION=1.6.37
ENV LIBPNG_BUILD_DIR=${BUILD_DIR}/libpng
RUN set -Eeuxo pipefail \
&& mkdir -p ${LIBPNG_BUILD_DIR} \
&& curl -L https://downloads.sourceforge.net/libpng/libpng-${LIBPNG_VERSION}.tar.xz \
| tar xJC ${LIBPNG_BUILD_DIR} --strip-components=1
WORKDIR ${LIBPNG_BUILD_DIR}/
RUN set -Eeuxo pipefail \
&& ./configure \
--prefix=${INSTALL_DIR} \
--disable-static \
&& make V=0 \
&& make install
# Install LibTIFF (http://www.linuxfromscratch.org/blfs/view/svn/general/libtiff.html)
#
# Pre-installed on Amazon Linux: 4.0.3
# Optional dependency of: libvips, Poppler
#
# ENV LIBTIFF_VERSION=4.1.0
# ENV LIBTIFF_BUILD_DIR=${BUILD_DIR}/tiff
# RUN set -Eeuxo pipefail \
# && mkdir -p ${LIBTIFF_BUILD_DIR} \
# && curl -L http://download.osgeo.org/libtiff/tiff-${LIBTIFF_VERSION}.tar.gz \
# | tar xzC ${LIBTIFF_BUILD_DIR} --strip-components=1
# WORKDIR ${LIBTIFF_BUILD_DIR}/
# RUN set -Eeuxo pipefail \
# && mkdir -p libtiff-build \
# && cd libtiff-build \
# && cmake .. \
# -DCMAKE_INSTALL_DOCDIR=/usr/share/doc/libtiff-4.1.0 \
# -DCMAKE_INSTALL_PREFIX=/usr -G Ninja \
# && ninja \
# && ninja install
# Install Libjpeg-Turbo (http://www.linuxfromscratch.org/blfs/view/svn/general/libjpeg.html)
#
# Pre-installed on Amazon Linux: no
# Recommended dependency of: Poppler
# Optional dependency of: libvips
#
ENV LIBJPEG_TURBO_VERSION=2.0.5
ENV LIBJPEG_TURBO_BUILD_DIR=${BUILD_DIR}/libjpeg
RUN set -Eeuxo pipefail \
&& mkdir -p ${LIBJPEG_TURBO_BUILD_DIR}/build \
&& curl -L https://downloads.sourceforge.net/libjpeg-turbo/libjpeg-turbo-${LIBJPEG_TURBO_VERSION}.tar.gz \
| tar xzC ${LIBJPEG_TURBO_BUILD_DIR} --strip-components=1
WORKDIR ${LIBJPEG_TURBO_BUILD_DIR}/build/
RUN set -Eeuxo pipefail \
&& cmake .. \
-DCMAKE_INSTALL_PREFIX=${INSTALL_DIR} \
-DCMAKE_BUILD_TYPE=RELEASE \
-DENABLE_STATIC=FALSE \
-DCMAKE_INSTALL_DEFAULT_LIBDIR=lib \
&& make V=0 \
&& make install
# Install libexif (http://www.linuxfromscratch.org/blfs/view/svn/general/libexif.html)
#
# Pre-installed on Amazon Linux: 0.6.21
# Optional dependency of: libvips
#
# ENV LIBEXIF_VERSION=0.6.22
# ENV LIBEXIF_VERSION_URL=0_6_22
# ENV LIBEXIF_BUILD_DIR=${BUILD_DIR}/libexif
# RUN set -Eeuxo pipefail \
# && mkdir -p ${LIBEXIF_BUILD_DIR} \
# && curl -L https://github.com/libexif/libexif/releases/download/libexif-${LIBEXIF_VERSION_URL}-release/libexif-${LIBEXIF_VERSION}.tar.xz \
# | tar xJC ${LIBEXIF_BUILD_DIR} --strip-components=1
# WORKDIR ${LIBEXIF_BUILD_DIR}
# RUN set -Eeuxo pipefail \
# && ./configure \
# --prefix=${INSTALL_DIR} \
# --disable-docs \
# --disable-static \
# && make V=0 \
# && make install
# Install OpenJPEG (http://www.linuxfromscratch.org/blfs/view/svn/general/openjpeg2.html)
#
# Pre-installed on Amazon Linux: no
# Recommended dependency of: Poppler
#
ENV OPENJPEG_VERSION=2.3.1
ENV OPENJPEG_BUILD_DIR=${BUILD_DIR}/openjpeg2
RUN set -Eeuxo pipefail \
&& mkdir -p ${OPENJPEG_BUILD_DIR}/build \
&& curl -L https://github.com/uclouvain/openjpeg/archive/v${OPENJPEG_VERSION}/openjpeg-${OPENJPEG_VERSION}.tar.gz \
| tar xzC ${OPENJPEG_BUILD_DIR} --strip-components=1
WORKDIR ${OPENJPEG_BUILD_DIR}/build/
RUN set -Eeuxo pipefail \
&& cmake .. \
-DCMAKE_BUILD_TYPE=Release \
-DCMAKE_INSTALL_PREFIX=${INSTALL_DIR} \
-DBUILD_STATIC_LIBS=OFF \
&& make V=0 \
&& make install
# Build libxml2 (http://www.linuxfromscratch.org/blfs/view/svn/general/libxml2.html)
#
# Pre-installed on Amazon Linux: 2.9.1
# Optional dependency of: Fontconfig (Poppler)
#
# ENV XML2_VERSION=2.9.10
# ENV XML2_BUILD_DIR=${BUILD_DIR}/libxml2
#RUN set -Eeuxo pipefail; \
# mkdir -p ${XML2_BUILD_DIR} \
# && curl -L http://xmlsoft.org/sources/libxml2-${XML2_VERSION}.tar.gz \
# | tar xzC ${XML2_BUILD_DIR} --strip-components=1
# WORKDIR ${XML2_BUILD_DIR}/
# RUN set -Eeuxo pipefail \
# && ./configure \
# --prefix=${INSTALL_DIR} \
# --with-sysroot=${INSTALL_DIR} \
# --disable-static \
# --with-history \
# --with-icu \
# --without-python
# RUN set -Eeuxo pipefail \
# && make install \
# && cp xml2-config ${INSTALL_DIR}/bin/xml2-config
# Install FreeType (http://www.linuxfromscratch.org/blfs/view/svn/general/freetype2.html)
#
# Pre-installed on Amazon Linux: 2.3.11
# Required by: Fontconfig (Poppler)
#
ENV FREETYPE_VERSION=2.10.2
ENV FREETYPE_BUILD_DIR=${BUILD_DIR}/freetype
RUN set -Eeuxo pipefail \
&& mkdir -p ${FREETYPE_BUILD_DIR} \
&& curl -L https://download-mirror.savannah.gnu.org/releases/freetype/freetype-${FREETYPE_VERSION}.tar.xz \
| tar xJC ${FREETYPE_BUILD_DIR} --strip-components=1
WORKDIR ${FREETYPE_BUILD_DIR}/
RUN set -Eeuxo pipefail \
&& sed -ri "s:.*(AUX_MODULES.*valid):\1:" modules.cfg
RUN set -Eeuxo pipefail \
&& sed -r "s:.*(#.*SUBPIXEL_RENDERING) .*:\1:" -i include/freetype/config/ftoption.h
RUN set -Eeuxo pipefail \
&& ./configure \
--prefix=${INSTALL_DIR} \
--with-sysroot=${INSTALL_DIR} \
--enable-freetype-config \
--disable-static \
&& make V=0 \
&& make install
# Install Harfbuzz (http://www.linuxfromscratch.org/blfs/view/svn/general/harfbuzz.html)
#
# Pre-installed on Amazon Linux: no
# Recommended dependency of: FreeType
#
ENV HARZBUFF_VERSION=2.7.0
ENV HARZBUFF_BUILD_DIR=${BUILD_DIR}/harfbuzz
RUN set -Eeuxo pipefail \
&& mkdir -p ${HARZBUFF_BUILD_DIR} \
&& curl -L https://github.com/harfbuzz/harfbuzz/archive/${HARZBUFF_VERSION}.tar.gz \
| tar xzC ${HARZBUFF_BUILD_DIR} --strip-components=1
WORKDIR ${HARZBUFF_BUILD_DIR}/
RUN set -Eeuxo pipefail \
&& mkdir build \
&& cd build \
&& meson \
--prefix=${INSTALL_DIR} \
&& ninja \
&& ninja install
# Now re-install FreeType
WORKDIR ${FREETYPE_BUILD_DIR}/
RUN set -Eeuxo pipefail \
&& ./configure \
--prefix=${INSTALL_DIR} \
--with-sysroot=${INSTALL_DIR} \
--enable-freetype-config \
--disable-static \
&& make V=0 \
&& make install
# Install Gperf (http://www.linuxfromscratch.org/blfs/view/7.4/general/gperf.html)
#
# Pre-installed on Amazon Linux: no
# Required by: Fontconfig
#
ENV GPERF_VERSION=3.1
ENV GPERF_BUILD_DIR=${BUILD_DIR}/gperf
RUN set -Eeuxo pipefail \
&& mkdir -p ${GPERF_BUILD_DIR} \
&& curl -L http://ftp.gnu.org/pub/gnu/gperf/gperf-${GPERF_VERSION}.tar.gz \
| tar xzC ${GPERF_BUILD_DIR} --strip-components=1
WORKDIR ${GPERF_BUILD_DIR}/
RUN set -Eeuxo pipefail \
&& ./configure \
--prefix=${INSTALL_DIR} \
&& make V=0 \
&& make install
# Install Fontconfig (http://www.linuxfromscratch.org/blfs/view/svn/general/fontconfig.html)
#
# Pre-installed on Amazon Linux: 2.8.0
# Required by: Poppler
# Requires: freetype and either expat or libxml2 (http://bio.gsi.de/DOCS/SOFTWARE/fontconfig.html) - not sure if that's still the case
#
ENV FONTCONFIG_VERSION=2.13.1
ENV FONTCONFIG_BUILD_DIR=${BUILD_DIR}/fontconfig
RUN set -Eeuxo pipefail \
&& mkdir -p ${FONTCONFIG_BUILD_DIR} \
&& curl -L https://www.freedesktop.org/software/fontconfig/release/fontconfig-${FONTCONFIG_VERSION}.tar.bz2 \
| tar xjC ${FONTCONFIG_BUILD_DIR} --strip-components=1
WORKDIR ${FONTCONFIG_BUILD_DIR}/
RUN set -Eeuxo pipefail \
&& rm -f src/fcobjshash.h
RUN set -Eeuxo pipefail \
&& LDFLAGS="-L${INSTALL_DIR}/lib64 -L${INSTALL_DIR}/lib" \
FONTCONFIG_PATH=${INSTALL_DIR} \
./configure \
--sysconfdir=${INSTALL_DIR}/etc \
--localstatedir=${INSTALL_DIR}/var \
--prefix=${INSTALL_DIR} \
--disable-docs \
# --enable-libxml2 \
&& make V=0 \
&& make install
# Install Pixman (http://www.linuxfromscratch.org/blfs/view/svn/general/pixman.html)
#
# Pre-installed on Amazon Linux: 0.32.4
# Required by: Cairo (Poppler)
#
ENV PIXMAN_VERSION=0.40.0
ENV PIXMAN_BUILD_DIR=${BUILD_DIR}/pixman
RUN set -Eeuxo pipefail \
&& mkdir -p ${PIXMAN_BUILD_DIR} \
&& curl -L https://www.cairographics.org/releases/pixman-${PIXMAN_VERSION}.tar.gz \
| tar xzC ${PIXMAN_BUILD_DIR} --strip-components=1
WORKDIR ${PIXMAN_BUILD_DIR}/
RUN set -Eeuxo pipefail \
&& mkdir build \
&& cd build \
&& meson --prefix=${INSTALL_DIR} \
&& ninja \
&& ninja install
# Install Cairo (http://www.linuxfromscratch.org/blfs/view/svn/x/cairo.html)
#
# Pre-installed on Amazon Linux: 1.12.14
# Recommend eddependency of: Poppler
#
ENV CAIRO_VERSION=1.17.2
ENV CAIRO_BUILD_DIR=${BUILD_DIR}/cairo
RUN set -Eeuxo pipefail \
&& mkdir -p ${CAIRO_BUILD_DIR} \
&& curl -L https://cairographics.org/snapshots/cairo-${CAIRO_VERSION}.tar.xz \
| tar xJC ${CAIRO_BUILD_DIR} --strip-components=1
WORKDIR ${CAIRO_BUILD_DIR}/
RUN set -Eeuxo pipefail \
&& autoreconf -fiv \
&& ./configure \
--prefix=${INSTALL_DIR} \
--disable-static \
--enable-tee \
&& make \
&& make install
# Install Little CMS (http://www.linuxfromscratch.org/blfs/view/svn/general/lcms2.html)
#
# Pre-installed on Amazon Linux: 2.6
# Recommended dependency of: Poppler
# Optional dependency of: libvips
#
ENV LCMS2_VERSION=2.11
ENV LCMS2_BUILD_DIR=${BUILD_DIR}/lcms
RUN set -Eeuxo pipefail \
&& mkdir -p ${LCMS2_BUILD_DIR} \
&& curl -L https://downloads.sourceforge.net/lcms/lcms2-${LCMS2_VERSION}.tar.gz \
| tar xzC ${LCMS2_BUILD_DIR} --strip-components=1
WORKDIR ${LCMS2_BUILD_DIR}/
RUN set -Eeuxo pipefail \
&& ./configure \
--prefix=${INSTALL_DIR} \
--disable-static \
&& make V=0 \
&& make install
# Install Poppler (http://www.linuxfromscratch.org/blfs/view/svn/general/poppler.html)
#
# Pre-installed on Amazon Linux: no
#
ENV POPPLER_VERSION=0.89.0
ENV POPPLER_BUILD_DIR=${BUILD_DIR}/poppler
# ENV POPPLER_TEST_DIR=${BUILD_DIR}/poppler-test
# RUN set -Eeuxo pipefail \
# && mkdir -p ${POPPLER_TEST_DIR} \
# && git clone git://git.freedesktop.org/git/poppler/test ${POPPLER_TEST_DIR}
RUN set -Eeuxo pipefail \
&& mkdir -p ${POPPLER_BUILD_DIR}/build \
&& curl -L https://poppler.freedesktop.org/poppler-${POPPLER_VERSION}.tar.xz \
| tar xJC ${POPPLER_BUILD_DIR} --strip-components=1
WORKDIR ${POPPLER_BUILD_DIR}/build/
RUN set -Eeuxo pipefail \
&& CFLAGS="" \
CPPFLAGS="-I${INSTALL_DIR}/include -I/usr/include" \
LDFLAGS="-L${INSTALL_DIR}/lib64 -L${INSTALL_DIR}/lib" \
cmake .. \
-DCMAKE_BUILD_TYPE=Release \
-DCMAKE_INSTALL_PREFIX=${INSTALL_DIR} \
# -DTESTDATADIR=${POPPLER_TEST_DIR} \
-DENABLE_UNSTABLE_API_ABI_HEADERS=ON \
-DENABLE_CPP=OFF \
-DENABLE_QT5=OFF \
-DENABLE_GLIB=ON \
-DENABLE_SPLASH=OFF \
&& make V=0 \
&& make install
# Install libimagequant
#
# Pre-installed on Amazon Linux: no
# Optional dependency of: libvips
#
# ENV LIBIMAGEQUANT_VERSION=2.12.6
# ENV LIBIMAGEQUANT_BUILD_DIR=${BUILD_DIR}/libimagequant
# RUN set -Eeuxo pipefail \
# && mkdir -p ${LIBIMAGEQUANT_BUILD_DIR} \
# && git clone https://github.com/ImageOptim/libimagequant.git ${LIBIMAGEQUANT_BUILD_DIR}
# WORKDIR ${LIBIMAGEQUANT_BUILD_DIR}
# RUN set -Eeuxo pipefail \
# && ./configure \
# --prefix=${INSTALL_DIR} && \
# make V=0 libimagequant.so && \
# make install
# Install orc (https://gitlab.freedesktop.org/gstreamer/orc/-/blob/master/.gitlab-ci.yml#L15)
#
# Pre-installed on Amazon Linux: no
# Optional dependency of: libvips
#
ENV ORC_VERSION=0.4.31
ENV ORC_BUILD_DIR=${BUILD_DIR}/orc
RUN set -Eeuxo pipefail \
&& mkdir -p ${ORC_BUILD_DIR} \
&& curl -L https://gstreamer.freedesktop.org/src/orc/orc-${ORC_VERSION}.tar.xz \
| tar xJC ${ORC_BUILD_DIR} --strip-components=1
WORKDIR ${ORC_BUILD_DIR}
RUN set -Eeuxo pipefail \
&& mkdir build \
&& cd build \
&& meson --prefix=${INSTALL_DIR} --werror \
&& ninja \
&& ninja install
# Install libvips (https://libvips.github.io/libvips/install.html)
#
# Pre-installed on Amazon Linux: no
#
ENV LIBVIPS_VERSION=8.9.2
ENV LIBVIPS_BUILD_DIR=${BUILD_DIR}/libvips
RUN set -Eeuxo pipefail \
&& mkdir -p ${LIBVIPS_BUILD_DIR} \
&& curl -L https://github.com/libvips/libvips/releases/download/v${LIBVIPS_VERSION}/vips-${LIBVIPS_VERSION}.tar.gz \
| tar xzC ${LIBVIPS_BUILD_DIR} --strip-components=1
WORKDIR ${LIBVIPS_BUILD_DIR}
RUN set -Eeuxo pipefail \
&& ./configure --prefix=${INSTALL_DIR} \
--without-gsf \
--without-fftw \
--without-magick \
--without-OpenEXR \
--without-nifti \
--without-heif \
--without-pdfium \
--without-rsvg \
--without-openslide \
--without-matio \
--without-cfitsio \
--without-libwebp \
--without-pangoft2 \
--without-tiff \
--without-giflib \
--without-imagequant \
--without-libexif \
--disable-gtk-doc \
&& make V=0 \
&& make install \
&& echo /opt/lib > /etc/ld.so.conf.d/libvips.conf \
&& ldconfig
FROM lambci/lambda:build-go1.x AS runtime-image
ENV SOURCE_DIR="/opt"
ENV INSTALL_DIR="/opt"
ENV PATH="/opt/bin:${PATH}" \
LD_LIBRARY_PATH="${INSTALL_DIR}/lib64:${INSTALL_DIR}/lib"
# Install zip
#
RUN set -Eeuxo pipefail \
&& yum update -y \
&& yum -y install zip \
&& yum -y clean all
# Copy all binaries/libaries
#
RUN set -Eeuxo pipefail \
&& mkdir -p ${INSTALL_DIR}/{etc,bin,var,share,lib}
COPY --from=compile-image /lib64/libuuid.so.* ${INSTALL_DIR}/lib/
COPY --from=compile-image ${SOURCE_DIR}/share/ /tmp/share
COPY --from=compile-image ${SOURCE_DIR}/etc/ ${INSTALL_DIR}/etc/
COPY --from=compile-image ${SOURCE_DIR}/bin/ ${INSTALL_DIR}/bin/
COPY --from=compile-image ${SOURCE_DIR}/var/ ${INSTALL_DIR}/var/
COPY --from=compile-image ${SOURCE_DIR}/lib/ ${INSTALL_DIR}/lib/
# COPY --from=compile-image ${SOURCE_DIR}/lib64/ ${INSTALL_DIR}/lib/
RUN set -Eeuxo pipefail \
&& cp -R /tmp/share/fontconfig ${INSTALL_DIR}/share/fontconfigI'm not sure if GLib is only needed at build time or if it's needed at runtime too and if I need to copy only the shared objects to my Lambda layer or the installed programs too. |
|
I'm still left a bit confused about which (optional) dependencies I should consider installing, and whether an old, pre-installed version is fine, or whether I should install the latest version to get the best performance/results. Installing the latest version will increase the size of the lambda layer and thus increase the cold start times by a bit. So it's a trade-off. @jcupitt I know I already asked you too much, but would you mind helping me and checking the boxes that you think are worth installing. Optional dependencies of libvips:
Required dependencies of Poppler:
Recommended (transitive) dependencies of Poppler:
Optional (transitive) dependencies of Poppler:
|
|
It depends what features you need. If you don't need to read and write TIFFs, you don't need libtiff. You'll need cairo for poppler to work, I think. lcms2 is very useful. The AWS versions of many of these packages are very old and have known security problems. You should probably build your own. |
|
Thank you so much! My Dockerfile builds fine now. Unfortunately, Poppler picks up the old versions. It appears as if it looks into FreeType should be at EDIT: Not sure if that's what's going on. It uses Fontconfig Interestingly, Poppler uses version For libvips I can't really tell from the logs which version it uses: Do you know how I can specify the correct version/paths? (I have updated the Dockerfile in my previous comment) |
|
I tried your dockerfile again -- there's a cmake 3.18.1 now, so you don't need the patch. libvips uses pkg-config to locate dependencies, so it'll pick up the correct versions automatically. You need to uncomment the final copy to get the lib64 stuff into your target. You add This will cause a variety of severe confusion. As a rule, don't add standard search locations with I'm not sure you need to set any I don't know why poppler is pickup up the wrong fontconfig etc. I think you have the .pc files and it's just not using them. I'd ask poppler. If I run a shell in your docker during poppler config, I see: So it finds the correct headers for fontconfig in I wonder a bit about the way you've built cmake: I'd try a more vanilla build I think. Just install to |
|
Thanks for your continuous help. I followed the instructions from Linux From Scratch for building
I'm not sure what is the motivation for not having applications install to If I omit the If I omit the I have changed my |
|
@jcupitt FYI: I filed an issue at the Poppler repo: https://gitlab.freedesktop.org/poppler/poppler/-/issues/948#note_587049 I'm still confused. There, I'm told that |
|
libpng has installed |
|
I had a read, and cmake will not use pkg-config unless you explicitly ask it to. It's because it has to work on platforms like Windows where pkg-config is not always available. Instead, it has a complex thing to find libpng: https://github.com/Kitware/CMake/blob/master/Modules/FindPNG.cmake You can set the path that these |
|
@jcupitt it works!!! Thank you so much! I can even do away with the Do you take contributions somewhere? I would like to buy you a coffee. |
|
Oh, that's great! There's a "sponsor" button at the top of the page, if you're feeling generous. |
I need to build libvips with poppler support for AWS Lambda. I need to build both libvips and poppler from source as they are not pre-installed on AWS Lambda (Amazon Linux 1).
I'm building all neceassry binaries and shared libraries to
/opt(opt/bin,opt/lib,opt/include, etc.). Libvips picks up most packages such as libimagequant from there. However, I can't get libvips to see poppler and cairo.Relevant parts of my Dockerfile:
Complete Dockerfile
Libvips configure output
While there are the flags
--with-pdfium-includesand--with-pdfium-librariesfor PDFium, there's no equivalent for poppler. I have rarely compiled libraries before, so I might miss something obvious.Thanks for any help
The text was updated successfully, but these errors were encountered: