Vips::Error: VipsForeignLoad: "/path/to/file.pdf" is not a known file format - installed using homebrew on macOS Ventura #3810

imrubyist · 2024-01-04T07:38:20Z

imrubyist
Jan 4, 2024

Any idea what am I missing to install?

Jan 8, 2024

You need to post a complete dockerfile that I can run or I won't be able to reproduce the problem.

I tried this one:

FROM ruby:3.1.4

RUN apt-get update -qq
RUN apt install -y --no-install-recommends libvips42
RUN gem install ruby-vips

(you only need libvips42, you don't need the -dev package, and --no-install-recommends can trim a lot from the download)

I can run it like this:

$ docker build -t kevinhq . 
$ cd ~/pics
$ docker run --rm -it -v .:/data kevinhq                                                                                                     
irb(main):001:0> require 'vips'
=> true
irb(main):002:0> x = Vips::Image.new_from_file "/data/nipguide.pdf"
=> #<Image 595x842 uchar…

View full answer

jcupitt · 2024-01-04T09:01:07Z

jcupitt
Jan 4, 2024
Maintainer

Hi @kevinhq,

It should work. On my mac I see:

08:54 $ brew update 
...
✔ ~ 
08:54 $ brew upgrade
...
08:55 $ vips -l | grep popp
        VipsForeignLoadPdf (pdfload_base), load PDF with libpoppler, priority=0, untrusted
✔ ~ 
08:58 $ vips -l | grep -i pdf
        VipsForeignLoadPdf (pdfload_base), load PDF with libpoppler, priority=0, untrusted
          VipsForeignLoadPdfFile (pdfload), load PDF from file (.pdf), priority=0, untrusted, is_a, get_flags, get_flags_filename, header, load
          VipsForeignLoadPdfBuffer (pdfload_buffer), load PDF from buffer, priority=0, untrusted, is_a_buffer, get_flags, get_flags_filename, header, load
          VipsForeignLoadPdfSource (pdfload_source), load PDF from source, priority=0, untrusted, is_a_source, get_flags, get_flags_filename, header, load
✔ ~/pics 
08:59 $ vips --version
vips-8.15.1
✔ ~/pics 
08:59 $ vipsheader nipguide.pdf
nipguide.pdf: 595x842 uchar, 4 bands, srgb, pdfload
✔ ~/pics 
08:59 $ 08:59 $ env
LC_PAPER=en_GB.UTF-8
MANPATH=/opt/homebrew/share/man:
LC_ADDRESS=en_GB.UTF-8
LC_MONETARY=en_GB.UTF-8
TERM=xterm-256color
SHELL=/bin/bash
CLICOLOR=1
HOMEBREW_REPOSITORY=/opt/homebrew
TMPDIR=/var/folders/pz/gm0pbl0d03x481qvb2dqppb40000gn/T/
SSH_CLIENT=192.168.1.65 33254 22
LC_NUMERIC=en_GB.UTF-8
SSH_TTY=/dev/ttys000
USER=john
LC_TELEPHONE=en_GB.UTF-8
PATH=/opt/homebrew/bin:/opt/homebrew/sbin:/usr/local/bin:/System/Cryptexes/App/usr/bin:/usr/bin:/bin:/usr/sbin:/sbin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/local/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/appleinternal/bin
LC_IDENTIFICATION=en_GB.UTF-8
PWD=/Users/john/pics
LANG=en_GB.UTF-8
LC_MEASUREMENT=en_GB.UTF-8
SHLVL=1
HOME=/Users/john
HOMEBREW_PREFIX=/opt/homebrew
LOGNAME=john
SSH_CONNECTION=192.168.1.65 33254 192.168.1.139 22
INFOPATH=/opt/homebrew/share/info:
HOMEBREW_CELLAR=/opt/homebrew/Cellar
LC_TIME=en_GB.UTF-8
LC_NAME=en_GB.UTF-8
_=/usr/bin/env
OLDPWD=/Users/john

0 replies

imrubyist · 2024-01-06T10:03:44Z

imrubyist
Jan 6, 2024
Author

@jcupitt Same vips version, but in my case it's without pdf support. Any idea what am I missing? I am on macbook pro m2 with macOS Ventura

P.S. Screenshot removed. See my further replies below.

5 replies

jcupitt Jan 6, 2024
Maintainer

Strange, it should work.

I'm using bash rather than zsh, could that be the issue?

(please don't post screenshots, I can't copy-paste from them to try stuff, I have to retype everything. Just copy paste the terminal text into github, enclosed in ``` triple backticks)

jcupitt Jan 6, 2024
Maintainer

Oh, and what's your PATH set to?

imrubyist Jan 6, 2024
Author

sorry.

kevin@localhost % brew update
Already up-to-date.
kevin@localhost % brew upgrade vips
Warning: vips 8.15.1_1 already installed

Oh. zsh. Lets see with bash.

jcupitt Jan 6, 2024
Maintainer

I thought of another thing you could try -- if you set the VIPS_IMFO env var it'll print a load of debug information on startup, including searches for modules. On my mac I see:

10:09 $ VIPS_INFO=1 vips
VIPS-INFO: 10:09:36.011: found /opt/homebrew/Cellar/vips/8.15.1_1/lib/vips-modules-8.15
VIPS-INFO: 10:09:36.013: using configure-time prefix
VIPS-INFO: 10:09:36.013: VIPS_PREFIX = /opt/homebrew/Cellar/vips/8.15.1_1
VIPS-INFO: 10:09:36.013: VIPS_LIBDIR = /opt/homebrew/Cellar/vips/8.15.1_1/lib
VIPS-INFO: 10:09:36.013: prefix = /opt/homebrew/Cellar/vips/8.15.1_1
VIPS-INFO: 10:09:36.013: libdir = /opt/homebrew/Cellar/vips/8.15.1_1/lib
VIPS-INFO: 10:09:36.013: searching "/opt/homebrew/Cellar/vips/8.15.1_1/lib/vips-modules-8.15"
VIPS-INFO: 10:09:36.013: loading "/opt/homebrew/Cellar/vips/8.15.1_1/lib/vips-modules-8.15/vips-heif.dylib"
VIPS-INFO: 10:09:36.021: loading "/opt/homebrew/Cellar/vips/8.15.1_1/lib/vips-modules-8.15/vips-magick.dylib"
VIPS-INFO: 10:09:36.023: loading "/opt/homebrew/Cellar/vips/8.15.1_1/lib/vips-modules-8.15/vips-poppler.dylib"
VIPS-INFO: 10:09:36.029: loading "/opt/homebrew/Cellar/vips/8.15.1_1/lib/vips-modules-8.15/vips-openslide.dylib"
VIPS-INFO: 10:09:36.034: loading "/opt/homebrew/Cellar/vips/8.15.1_1/lib/vips-modules-8.15/vips-jxl.dylib"
VIPS-INFO: 10:09:36.035: searching "/opt/homebrew/Cellar/vips/8.15.1_1/lib/vips-plugins-8.15"
VIPS-INFO: 10:09:36.036: im_load_plugins: searching "/opt/homebrew/Cellar/vips/8.15.1_1/lib/vips-8.15"

VIPS-INFO: 10:09:36.036: im_load_plugins: searching "/opt/homebrew/Cellar/vips/8.15.1_1/lib"

Usage:
  vips [OPTION…] [ACTION] [OPTIONS] [PARAMETERS] - VIPS driver program

Help Options:
  -h, --help                     Show help options

Application Options:
  -t, --targets                  print vector targets
  -l, --list=BASE-NAME           list objects
  -p, --plugin=PLUGIN            load PLUGIN
  -v, --version                  print version
  -c, --completion=BASE-NAME     print completions
  --vips-concurrency=N           evaluate with N concurrent threads
  --vips-progress                show progress feedback
  --vips-leak                    leak-check on exit
  --vips-profile                 profile and dump timing on exit
  --vips-disc-threshold=N        images larger than N are decompressed to disc
  --vips-novector                disable vectorised versions of operations
  --vips-cache-max=N             cache at most N operations
  --vips-cache-max-memory=N      cache at most N bytes in memory
  --vips-cache-max-files=N       allow at most N open files
  --vips-cache-trace             trace operation cache
  --vips-cache-dump              dump operation cache on exit
  --vips-version                 print libvips version
  --vips-config                  print libvips config
  --vips-pipe-read-limit         read at most this many bytes from a pipe

You can see mine is loading /opt/homebrew/Cellar/vips/8.15.1_1/lib/vips-modules-8.15/vips-poppler.dylib during init.

I would see if you have that library present.

imrubyist Jan 6, 2024
Author

here's mine:

kevin@localhost ~ % VIPS_INFO=1 vips
VIPS-INFO: 17:15:01.100: VIPSHOME = /usr/local
VIPS-INFO: 17:15:01.101: VIPS_PREFIX = /opt/homebrew/Cellar/vips/8.15.1_1
VIPS-INFO: 17:15:01.101: VIPS_LIBDIR = /opt/homebrew/Cellar/vips/8.15.1_1/lib
VIPS-INFO: 17:15:01.101: prefix = /usr/local
VIPS-INFO: 17:15:01.101: libdir = /usr/local/lib
VIPS-INFO: 17:15:01.108: searching "/usr/local/lib/vips-modules-8.15"
VIPS-INFO: 17:15:01.109: searching "/usr/local/lib/vips-plugins-8.15"
VIPS-INFO: 17:15:01.109: im_load_plugins: searching "/usr/local/lib/vips-8.15"

VIPS-INFO: 17:15:01.109: im_load_plugins: searching "/usr/local/lib"

Usage:
  vips [OPTION…] [ACTION] [OPTIONS] [PARAMETERS] - VIPS driver program

Help Options:
  -h, --help                     Show help options

Application Options:
  -t, --targets                  print vector targets
  -l, --list=BASE-NAME           list objects
  -p, --plugin=PLUGIN            load PLUGIN
  -v, --version                  print version
  -c, --completion=BASE-NAME     print completions
  --vips-concurrency=N           evaluate with N concurrent threads
  --vips-progress                show progress feedback
  --vips-leak                    leak-check on exit
  --vips-profile                 profile and dump timing on exit
  --vips-disc-threshold=N        images larger than N are decompressed to disc
  --vips-novector                disable vectorised versions of operations
  --vips-cache-max=N             cache at most N operations
  --vips-cache-max-memory=N      cache at most N bytes in memory
  --vips-cache-max-files=N       allow at most N open files
  --vips-cache-trace             trace operation cache
  --vips-cache-dump              dump operation cache on exit
  --vips-version                 print libvips version
  --vips-config                  print libvips config
  --vips-pipe-read-limit         read at most this many bytes from a pipe

There is no vips-poppler.dylib. Weird.

imrubyist · 2024-01-06T10:10:40Z

imrubyist
Jan 6, 2024
Author

Oh, and what's your PATH set to?

echo $PATH   
/Users/kevin/.rvm/gems/ruby-3.1.4@benchtop/bin:/Users/kevin/.rvm/gems/ruby-3.1.4@global/bin:/Users/kevin/.rvm/rubies/ruby-3.1.4/bin:/Users/kevin/.rvm/bin:/opt/homebrew/opt/openssl@1.1/bin:/opt/homebrew/bin:/opt/homebrew/sbin:/usr/local/bin:/System/Cryptexes/App/usr/bin:/usr/bin:/bin:/usr/sbin:/sbin:/opt/X11/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/local/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/appleinternal/bin

2 replies

jcupitt Jan 6, 2024
Maintainer

You could also try:

10:12 $ which vips
/opt/homebrew/bin/vips

Just to verify that you have the homebrew one running.

imrubyist Jan 6, 2024
Author

this returns:

kevin@localhost ~ % which vips
/opt/homebrew/bin/vips
kevin@localhost ~ %

imrubyist · 2024-01-06T10:18:03Z

imrubyist
Jan 6, 2024
Author

@jcupitt I wonder if I need to install vips in different way? I just run brew install vips earlier.

0 replies

imrubyist · 2024-01-06T10:30:18Z

imrubyist
Jan 6, 2024
Author

@jcupitt More update: I switch to bash, uninstall vips, and install it again with brew install vips then it still doesn't have support for PDF. Here's the log:

ks-MacBook-Pro:~ kevin$ echo $0
-bash
ks-MacBook-Pro:~ kevin$ vips --version
vips-8.15.1
ks-MacBook-Pro:~ kevin$ which vips
/opt/homebrew/bin/vips
ks-MacBook-Pro:~ kevin$ vips -l | grep popp
ks-MacBook-Pro:~ kevin$ VIPS_INFO=1 vips
VIPS-INFO: 17:29:30.285: VIPSHOME = /usr/local
VIPS-INFO: 17:29:30.285: VIPS_PREFIX = /opt/homebrew/Cellar/vips/8.15.1_1
VIPS-INFO: 17:29:30.285: VIPS_LIBDIR = /opt/homebrew/Cellar/vips/8.15.1_1/lib
VIPS-INFO: 17:29:30.285: prefix = /usr/local
VIPS-INFO: 17:29:30.285: libdir = /usr/local/lib
VIPS-INFO: 17:29:30.286: searching "/usr/local/lib/vips-modules-8.15"
VIPS-INFO: 17:29:30.288: searching "/usr/local/lib/vips-plugins-8.15"
VIPS-INFO: 17:29:30.288: im_load_plugins: searching "/usr/local/lib/vips-8.15"

VIPS-INFO: 17:29:30.288: im_load_plugins: searching "/usr/local/lib"

Usage:
  vips [OPTION…] [ACTION] [OPTIONS] [PARAMETERS] - VIPS driver program

Help Options:
  -h, --help                     Show help options

Application Options:
  -t, --targets                  print vector targets
  -l, --list=BASE-NAME           list objects
  -p, --plugin=PLUGIN            load PLUGIN
  -v, --version                  print version
  -c, --completion=BASE-NAME     print completions
  --vips-concurrency=N           evaluate with N concurrent threads
  --vips-progress                show progress feedback
  --vips-leak                    leak-check on exit
  --vips-profile                 profile and dump timing on exit
  --vips-disc-threshold=N        images larger than N are decompressed to disc
  --vips-novector                disable vectorised versions of operations
  --vips-cache-max=N             cache at most N operations
  --vips-cache-max-memory=N      cache at most N bytes in memory
  --vips-cache-max-files=N       allow at most N open files
  --vips-cache-trace             trace operation cache
  --vips-cache-dump              dump operation cache on exit
  --vips-version                 print libvips version
  --vips-config                  print libvips config
  --vips-pipe-read-limit         read at most this many bytes from a pipe

12 replies

imrubyist Jan 8, 2024
Author

Update:

irb(main):004:0> Vips.get_suffixes.sort!
=> 
[".avif",
 ".bmp",
 ".csv",
 ".dz",
 ".fit",
 ".fits",
 ".fts",
 ".gif",
 ".hdr",
 ".heic",
 ".heif",
 ".j2c",
 ".j2k",
 ".jp2",
 ".jpc",
 ".jpe",
 ".jpeg",
 ".jpg",
 ".jpt",
 ".jxl",
 ".mat",
 ".pbm",
 ".pfm",
 ".pgm",
 ".png",
 ".pnm",
 ".ppm",
 ".raw",
 ".szi",
 ".tif",
 ".tiff",
 ".v",
 ".vips",
 ".webp"]

looks like, though vips -l | grep -i pdf shows it's supporting pdf, the one runs inside ruby irb console didn't show suffix of .pdf

So, something isn't right with ruby-vips

imrubyist Jan 8, 2024
Author

and the same issue is with docker on macOS ventura.

imrubyist Jan 8, 2024
Author

but vips pdfload is working. any idea why ruby-vips gem didn't have the pdfload method?

jcupitt Jan 8, 2024
Maintainer

You need to post a complete dockerfile that I can run or I won't be able to reproduce the problem.

I tried this one:

FROM ruby:3.1.4

RUN apt-get update -qq
RUN apt install -y --no-install-recommends libvips42
RUN gem install ruby-vips

(you only need libvips42, you don't need the -dev package, and --no-install-recommends can trim a lot from the download)

I can run it like this:

$ docker build -t kevinhq . 
$ cd ~/pics
$ docker run --rm -it -v .:/data kevinhq                                                                                                     
irb(main):001:0> require 'vips'
=> true
irb(main):002:0> x = Vips::Image.new_from_file "/data/nipguide.pdf"
=> #<Image 595x842 uchar, 4 bands, srgb>
irb(main):003:0> x.get("vips-loader")
=> "pdfload"
irb(main):004:0>

So it all seems to be working.

This isn't working:

irb(main):004:0> Vips::get_suffixes.grep "pdf"
=> []

Which is puzzling, I'm not sure why. But it shouldn't matter.

Answer selected by imrubyist

kleisauke Jan 8, 2024
Collaborator

Which is puzzling, I'm not sure why.

Vips.get_suffixes / vips_foreign_get_suffixes() would only return the supported save extensions.

libvips/libvips/foreign/foreign.c

Lines 2052 to 2053 in 4086544

    
            * This is not the same as all the supported file types, since libvips 
        
            * detects image format for load by testing the first few bytes.

jcupitt Jan 8, 2024
Maintainer

Ahhhh of course, get_suffixes is just the save suffixes.

Loaders don't look at the filename suffix, they sniff the first few bytes, so the list of supported suffixes is not relevant.

The docs explain:

https://www.libvips.org/API/current/VipsForeignSave.html#vips-foreign-get-suffixes

jcupitt Jan 8, 2024
Maintainer

Hehe snap.

imrubyist Jan 8, 2024
Author

@jcupitt

FROM ruby:3.1.4                                                                                                                                                                                      

RUN mkdir /app
WORKDIR /app

RUN apt-get install -y ca-certificates curl gnupg
RUN mkdir -p /etc/apt/keyrings
RUN curl -fsSL https://deb.nodesource.com/gpgkey/nodesource-repo.gpg.key | gpg --dearmor -o /etc/apt/keyrings/nodesource.gpg
RUN echo "deb [signed-by=/etc/apt/keyrings/nodesource.gpg] https://deb.nodesource.com/node_18.x nodistro main" | tee /etc/apt/sources.list.d/nodesource.list
RUN apt update
RUN apt install -y libvips-dev nodejs npm
RUN npm install -g yarn

COPY Gemfile* /app/
RUN bundle

imrubyist · 2024-01-09T07:36:49Z

imrubyist
Jan 9, 2024
Author

You need to post a complete dockerfile that I can run or I won't be able to reproduce the problem.

I tried this one:
FROM ruby:3.1.4

RUN apt-get update -qq
RUN apt install -y --no-install-recommends libvips42
RUN gem install ruby-vips
(you only need libvips42, you don't need the -dev package, and --no-install-recommends can trim a lot from the download)

I can run it like this:
$ docker build -t kevinhq . 
$ cd ~/pics
$ docker run --rm -it -v .:/data kevinhq                                                                                                     
irb(main):001:0> require 'vips'
=> true
irb(main):002:0> x = Vips::Image.new_from_file "/data/nipguide.pdf"
=> #<Image 595x842 uchar, 4 bands, srgb>
irb(main):003:0> x.get("vips-loader")
=> "pdfload"
irb(main):004:0> 
So it all seems to be working.

This isn't working:
irb(main):004:0> Vips::get_suffixes.grep "pdf"
=> []

This is actually the answer.

Additional notes: For invalid PDF file, it did returned such error. I expect it will return better error message like invalid PDF file instead of confusing error message: pdf is not a known file format

1 reply

jcupitt Jan 9, 2024
Maintainer

But it doesn't know it's a PDF (it fails the "is-this-a-PDF" test), so it can't tell you it's an invalid PDF.

The error message could be changed to "unable to determine image format", maybe that would be better?

imrubyist · 2024-01-12T01:25:10Z

imrubyist
Jan 12, 2024
Author

But it doesn't know it's a PDF (it fails the "is-this-a-PDF" test), so it can't tell you it's an invalid PDF.

The error message could be changed to "unable to determine image format", maybe that would be better?

Actually it doesn't matter. Because those Vips::Error are still triggered for:

invalid/corrupt pdf.
pdf that didn't exist or on wrong path

so i think it's beyond this libvips and no need to worry about these. All good now.

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Vips::Error: VipsForeignLoad: "/path/to/file.pdf" is not a known file format - installed using homebrew on macOS Ventura #3810

{{title}}

Replies: 7 comments 20 replies

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

Select a reply

Vips::Error: VipsForeignLoad: "/path/to/file.pdf" is not a known file format - installed using homebrew on macOS Ventura #3810

imrubyist Jan 4, 2024

Replies: 7 comments · 20 replies

jcupitt Jan 4, 2024 Maintainer

imrubyist Jan 6, 2024 Author

jcupitt Jan 6, 2024 Maintainer

jcupitt Jan 6, 2024 Maintainer

imrubyist Jan 6, 2024 Author

jcupitt Jan 6, 2024 Maintainer

imrubyist Jan 6, 2024 Author

imrubyist Jan 6, 2024 Author

jcupitt Jan 6, 2024 Maintainer

imrubyist Jan 6, 2024 Author

imrubyist Jan 6, 2024 Author

imrubyist Jan 6, 2024 Author

imrubyist Jan 8, 2024 Author

imrubyist Jan 8, 2024 Author

imrubyist Jan 8, 2024 Author

jcupitt Jan 8, 2024 Maintainer

kleisauke Jan 8, 2024 Collaborator

jcupitt Jan 8, 2024 Maintainer

jcupitt Jan 8, 2024 Maintainer

imrubyist Jan 8, 2024 Author

imrubyist Jan 9, 2024 Author

jcupitt Jan 9, 2024 Maintainer

imrubyist Jan 12, 2024 Author

imrubyist
Jan 4, 2024

Replies: 7 comments 20 replies

jcupitt
Jan 4, 2024
Maintainer

imrubyist
Jan 6, 2024
Author

jcupitt Jan 6, 2024
Maintainer

jcupitt Jan 6, 2024
Maintainer

imrubyist Jan 6, 2024
Author

jcupitt Jan 6, 2024
Maintainer

imrubyist Jan 6, 2024
Author

imrubyist
Jan 6, 2024
Author

jcupitt Jan 6, 2024
Maintainer

imrubyist Jan 6, 2024
Author

imrubyist
Jan 6, 2024
Author

imrubyist
Jan 6, 2024
Author

imrubyist Jan 8, 2024
Author

imrubyist Jan 8, 2024
Author

imrubyist Jan 8, 2024
Author

jcupitt Jan 8, 2024
Maintainer

kleisauke Jan 8, 2024
Collaborator

jcupitt Jan 8, 2024
Maintainer

jcupitt Jan 8, 2024
Maintainer

imrubyist Jan 8, 2024
Author

imrubyist
Jan 9, 2024
Author

jcupitt Jan 9, 2024
Maintainer

imrubyist
Jan 12, 2024
Author