vipsthumbnail takes too long to process WebP animated image #3596

rtio · 2023-08-07T20:11:44Z

rtio
Aug 7, 2023

I need help understanding why this is taking so long to process this animated WebP image. The best time I could get was from the Mac M1 Max but when running it inside the container the execution time is over one minute. I put three examples, the original image, and the command I'm running.

big.webp

# M1 Max
vipsthumbnail big.webp: done in 1,52s
vipsthumbnail temp-26: done in 4,88s
# Intel Xeon
vipsthumbnail big.webp: done in 6.4s
vipsthumbnail temp-26: done in 18.9s
# Linux Container
vipsthumbnail big.webp: done in 16.6s          
vipsthumbnail temp-26: done in 237s

Mac M1 Max - vips-8.14.3

vipsthumbnail 'big.webp[n=-1]' --vips-progress --vips-info --vips-cache-trace --vips-leak --size 540 -o big540.webp
VIPS-INFO: 16:56:00.933: thumbnailing big.webp[n=-1]
vips cache+: webpload filename="big.webp" out=((VipsImage*) 0x14062eef0) n=-1 flags=((VipsForeignFlags) VIPS_FOREIGN_NONE) -
VIPS-INFO: 16:56:00.944: selected loader is VipsForeignLoadWebpFile
VIPS-INFO: 16:56:00.944: input size is 1920 x 122040
VIPS-INFO: 16:56:00.944: loading with factor 3,55556 pre-shrink
vips cache+: webpload filename="big.webp" out=((VipsImage*) 0x14062f780) n=-1 scale=0,281250 flags=((VipsForeignFlags) VIPS_FOREIGN_NONE) access=((VipsAccess) VIPS_ACCESS_SEQUENTIAL) fail-on=((VipsFailOn) VIPS_FAIL_ON_NONE) -
VIPS-INFO: 16:56:00.945: pre-shrunk size is 1920 x 122040
VIPS-INFO: 16:56:00.945: converting to processing space srgb
vips cache+: colourspace in=((VipsImage*) 0x14062f780) out=((VipsImage*) 0x140630010) space=((VipsInterpretation) VIPS_INTERPRETATION_sRGB) -
VIPS-INFO: 16:56:00.945: premultiplying alpha
vips cache : copy in=((VipsImage*) 0x140630010) out=((VipsImage*) 0x140630530) -
vips cache+: premultiply in=((VipsImage*) 0x140630010) out=((VipsImage*) 0x1406303a0) -
vips cache : copy in=((VipsImage*) 0x1406303a0) out=((VipsImage*) 0x140630850) -
VIPS-INFO: 16:56:00.945: residual reducev by 0,281481
VIPS-INFO: 16:56:00.945: reducev: 23 point mask
vips cache : copy in=((VipsImage*) 0x140630850) out=((VipsImage*) 0x140630be0) -
vips cache+: embed in=((VipsImage*) 0x140630be0) out=((VipsImage*) 0x140630d70) x=0 y=11 width=1920 height=122063 extend=((VipsExtend) VIPS_EXTEND_COPY) -
VIPS-INFO: 16:56:00.945: reducev sequential line cache
vips cache+: linecache in=((VipsImage*) 0x140630f00) out=((VipsImage*) 0x140631220) tile-height=10 access=((VipsAccess) VIPS_ACCESS_SEQUENTIAL) -
vips cache+: sequential in=((VipsImage*) 0x140630f00) out=((VipsImage*) 0x140631090) tile-height=10 -
vips cache+: reducev in=((VipsImage*) 0x140630850) out=((VipsImage*) 0x1406301a0) vshrink=3,552632 kernel=((VipsKernel) VIPS_KERNEL_LANCZOS3) gap=2,000000 -
VIPS-INFO: 16:56:00.945: residual reduceh by 0,28125
VIPS-INFO: 16:56:00.945: reduceh: 23 point mask
vips cache : copy in=((VipsImage*) 0x1406301a0) out=((VipsImage*) 0x1406309e0) -
vips cache+: embed in=((VipsImage*) 0x1406309e0) out=((VipsImage*) 0x140631740) x=11 y=0 width=1943 height=34352 extend=((VipsExtend) VIPS_EXTEND_COPY) -
vips cache+: reduceh in=((VipsImage*) 0x1406301a0) out=((VipsImage*) 0x1406315b0) hshrink=3,555556 kernel=((VipsKernel) VIPS_KERNEL_LANCZOS3) gap=2,000000 -
vips cache+: resize in=((VipsImage*) 0x1406303a0) out=((VipsImage*) 0x1406306c0) vscale=0,281481 scale=0,281250 -
VIPS-INFO: 16:56:00.945: unpremultiplying alpha
vips cache : copy in=((VipsImage*) 0x1406306c0) out=((VipsImage*) 0x140631e60) -
vips cache+: unpremultiply in=((VipsImage*) 0x1406306c0) out=((VipsImage*) 0x140631cd0) -
vips cache : copy in=((VipsImage*) 0x140631cd0) out=((VipsImage*) 0x140632180) -
vips cache+: cast in=((VipsImage*) 0x140631cd0) out=((VipsImage*) 0x140631ff0) format=((VipsBandFormat) VIPS_FORMAT_UCHAR) -
vips cache : copy in=((VipsImage*) 0x140631ff0) out=((VipsImage*) 0x140632310) -
vips cache : thumbnail filename="big.webp[n=-1]" out=((VipsImage*) 0x1406324a0) width=540 height=540 size=((VipsSize) VIPS_SIZE_BOTH) no-rotate=FALSE crop=((VipsInteresting) VIPS_INTERESTING_NONE) linear=FALSE import-profile=NULL export-profile=NULL intent=((VipsIntent) VIPS_INTENT_RELATIVE) -
VIPS-INFO: 16:56:00.945: thumbnailing big.webp[n=-1] as ./big540.webp
vips cache+: cast in=((VipsImage*) 0x1406324a0) out=((VipsImage*) 0x1406327e0) format=((VipsBandFormat) VIPS_FORMAT_UCHAR) -
vips cache : copy in=((VipsImage*) 0x1406327e0) out=((VipsImage*) 0x140632970) -
vipsthumbnail temp-26: 540 x 34352 pixels, 10 threads, 540 x 16 tiles, 256 lines in buffer
vips cache+: linecache in=((VipsImage*) 0x1418044f0) out=((VipsImage*) 0x141804d50) tile-height=1 access=((VipsAccess) VIPS_ACCESS_SEQUENTIAL) -
vips cache+: sequential in=((VipsImage*) 0x1418044f0) out=((VipsImage*) 0x141804bc0) -
VIPS-INFO: 16:56:00.948: vips__open_image_write: O_TMPFILE not available
VIPS-INFO: 16:56:00.948: vips__open_image_write: simple open
vipsthumbnail big.webp: 1920 x 122040 pixels, 10 threads, 1920 x 16 tiles, 256 lines in buffer
vipsthumbnail big.webp: done in 1,52s
vipsthumbnail temp-26: done in 4,88s
vips cache : webpsave_target in=((VipsImage*) 0x1406324a0) target=((VipsTarget*) 0x140850c00) -
vips_threadset_free: peak of 16 threads
memory: high-water mark 93,50 MB

Linux Intel Xeon Processor 30 core - vips-8.14.3

vipsthumbnail 'big.webp[n=-1]' --vips-progress --vips-info --vips-cache-trace --vips-leak --size 540 -o big540.webp
VIPS-INFO: 15:59:22.948: thumbnailing big.webp[n=-1]
vips cache+: webpload filename="big.webp" out=((VipsImage*) 0xcb21b0) n=-1 flags=((VipsForeignFlags) VIPS_FOREIGN_NONE) -
VIPS-INFO: 15:59:22.949: selected loader is VipsForeignLoadWebpFile
VIPS-INFO: 15:59:22.949: input size is 1920 x 122040
VIPS-INFO: 15:59:22.949: loading with factor 3.55556 pre-shrink
vips cache+: webpload filename="big.webp" out=((VipsImage*) 0xcb24d0) n=-1 scale=0.281250 flags=((VipsForeignFlags) VIPS_FOREIGN_NONE) access=((VipsAccess) VIPS_ACCESS_SEQUENTIAL) fail-on=((VipsFailOn) VIPS_FAIL_ON_NONE) -
VIPS-INFO: 15:59:22.949: pre-shrunk size is 1920 x 122040
VIPS-INFO: 15:59:22.949: converting to processing space srgb
vips cache+: colourspace in=((VipsImage*) 0xcb24d0) out=((VipsImage*) 0xcb27f0) space=((VipsInterpretation) VIPS_INTERPRETATION_sRGB) -
VIPS-INFO: 15:59:22.949: premultiplying alpha
vips cache : copy in=((VipsImage*) 0xcb27f0) out=((VipsImage*) 0xcb2b10) -
vips cache+: premultiply in=((VipsImage*) 0xcb27f0) out=((VipsImage*) 0xcb2980) -
vips cache : copy in=((VipsImage*) 0xcb2980) out=((VipsImage*) 0xcb2e30) -
VIPS-INFO: 15:59:22.950: residual reducev by 0.281481
VIPS-INFO: 15:59:22.950: reducev: 23 point mask
vips cache : copy in=((VipsImage*) 0xcb2e30) out=((VipsImage*) 0xd691a0) -
vips cache+: embed in=((VipsImage*) 0xd691a0) out=((VipsImage*) 0xd69330) x=0 y=11 width=1920 height=122063 extend=((VipsExtend) VIPS_EXTEND_COPY) -
VIPS-INFO: 15:59:22.950: reducev sequential line cache
vips cache+: linecache in=((VipsImage*) 0xd694c0) out=((VipsImage*) 0xd697e0) tile-height=10 access=((VipsAccess) VIPS_ACCESS_SEQUENTIAL) -
vips cache+: sequential in=((VipsImage*) 0xd694c0) out=((VipsImage*) 0xd69650) tile-height=10 -
vips cache+: reducev in=((VipsImage*) 0xcb2e30) out=((VipsImage*) 0xd69010) vshrink=3.552632 kernel=((VipsKernel) VIPS_KERNEL_LANCZOS3) gap=2.000000 -
VIPS-INFO: 15:59:22.950: residual reduceh by 0.28125
VIPS-INFO: 15:59:22.950: reduceh: 23 point mask
vips cache : copy in=((VipsImage*) 0xd69010) out=((VipsImage*) 0xd69b00) -
vips cache+: embed in=((VipsImage*) 0xd69b00) out=((VipsImage*) 0xd69c90) x=11 y=0 width=1943 height=34352 extend=((VipsExtend) VIPS_EXTEND_COPY) -
vips cache+: reduceh in=((VipsImage*) 0xd69010) out=((VipsImage*) 0xd69970) hshrink=3.555556 kernel=((VipsKernel) VIPS_KERNEL_LANCZOS3) gap=2.000000 -
vips cache+: resize in=((VipsImage*) 0xcb2980) out=((VipsImage*) 0xcb2ca0) vscale=0.281481 scale=0.281250 -
VIPS-INFO: 15:59:22.950: unpremultiplying alpha
vips cache : copy in=((VipsImage*) 0xcb2ca0) out=((VipsImage*) 0xd8f020) -
vips cache+: unpremultiply in=((VipsImage*) 0xcb2ca0) out=((VipsImage*) 0xd69e20) -
vips cache : copy in=((VipsImage*) 0xd69e20) out=((VipsImage*) 0xd8f340) -
vips cache+: cast in=((VipsImage*) 0xd69e20) out=((VipsImage*) 0xd8f1b0) format=((VipsBandFormat) VIPS_FORMAT_UCHAR) -
vips cache : copy in=((VipsImage*) 0xd8f1b0) out=((VipsImage*) 0xd8f4d0) -
vips cache : thumbnail filename="big.webp[n=-1]" out=((VipsImage*) 0xd8f660) width=540 height=540 size=((VipsSize) VIPS_SIZE_BOTH) no-rotate=FALSE crop=((VipsInteresting) VIPS_INTERESTING_NONE) linear=FALSE import-profile=NULL export-profile=NULL intent=((VipsIntent) VIPS_INTENT_RELATIVE) -
VIPS-INFO: 15:59:22.951: thumbnailing big.webp[n=-1] as ./big540.webp
vips cache+: cast in=((VipsImage*) 0xd8f660) out=((VipsImage*) 0xd8f7f0) format=((VipsBandFormat) VIPS_FORMAT_UCHAR) -
vips cache : copy in=((VipsImage*) 0xd8f7f0) out=((VipsImage*) 0xd8f980) -
vipsthumbnail temp-26: 540 x 34352 pixels, 30 threads, 540 x 16 tiles, 512 lines in buffer
vips cache+: linecache in=((VipsImage*) 0xd8fe30) out=((VipsImage*) 0x7f17d4033330) tile-height=1 access=((VipsAccess) VIPS_ACCESS_SEQUENTIAL) -
vips cache+: sequential in=((VipsImage*) 0xd8fe30) out=((VipsImage*) 0x7f17d40331a0) -
VIPS-INFO: 15:59:23.006: vips__open_image_write: opening with O_TMPFILE
VIPS-INFO: 15:59:23.006: vips__open_image_write: O_TMPFILE failed!
VIPS-INFO: 15:59:23.006: vips__open_image_write: simple open
vipsthumbnail big.webp: 1920 x 122040 pixels, 30 threads, 1920 x 16 tiles, 512 lines in buffer
vipsthumbnail big.webp: done in 6.4s
vipsthumbnail temp-26: done in 18.9s
vips cache : webpsave_target in=((VipsImage*) 0xd8f660) target=((VipsTarget*) 0xd98000) -
vips_threadset_free: peak of 36 threads
memory: high-water mark 132.59 MB

Docker container running over the same Mac M1 Max - vips-8.14.3

vipsthumbnail 'big.webp[n=-1]' --vips-progress --vips-info --vips-cache-trace --vips-leak --size 540 -o big540.webp
VIPS-INFO: 19:59:11.409: thumbnailing big.webp[n=-1]
vips cache+: webpload filename="big.webp" out=((VipsImage*) 0x6331b0) n=-1 flags=((VipsForeignFlags) VIPS_FOREIGN_NONE) -
VIPS-INFO: 19:59:11.437: selected loader is VipsForeignLoadWebpFile
VIPS-INFO: 19:59:11.439: input size is 1920 x 122040
VIPS-INFO: 19:59:11.439: loading with factor 3.55556 pre-shrink
vips cache+: webpload filename="big.webp" out=((VipsImage*) 0x6334d0) n=-1 scale=0.281250 flags=((VipsForeignFlags) VIPS_FOREIGN_NONE) access=((VipsAccess) VIPS_ACCESS_SEQUENTIAL) fail-on=((VipsFailOn) VIPS_FAIL_ON_NONE) -
VIPS-INFO: 19:59:11.452: pre-shrunk size is 1920 x 122040
VIPS-INFO: 19:59:11.452: converting to processing space srgb
vips cache+: colourspace in=((VipsImage*) 0x6334d0) out=((VipsImage*) 0x6337f0) space=((VipsInterpretation) VIPS_INTERPRETATION_sRGB) -
VIPS-INFO: 19:59:11.453: premultiplying alpha
vips cache : copy in=((VipsImage*) 0x6337f0) out=((VipsImage*) 0x633b10) -
vips cache+: premultiply in=((VipsImage*) 0x6337f0) out=((VipsImage*) 0x633980) -
vips cache : copy in=((VipsImage*) 0x633980) out=((VipsImage*) 0x633e30) -
VIPS-INFO: 19:59:11.455: residual reducev by 0.281481
VIPS-INFO: 19:59:11.456: reducev: 23 point mask
vips cache : copy in=((VipsImage*) 0x633e30) out=((VipsImage*) 0x6eb1a0) -
vips cache+: embed in=((VipsImage*) 0x6eb1a0) out=((VipsImage*) 0x6eb330) x=0 y=11 width=1920 height=122063 extend=((VipsExtend) VIPS_EXTEND_COPY) -
VIPS-INFO: 19:59:11.460: reducev sequential line cache
vips cache+: linecache in=((VipsImage*) 0x6eb4c0) out=((VipsImage*) 0x6eb7e0) tile-height=10 access=((VipsAccess) VIPS_ACCESS_SEQUENTIAL) -
vips cache+: sequential in=((VipsImage*) 0x6eb4c0) out=((VipsImage*) 0x6eb650) tile-height=10 -
vips cache+: reducev in=((VipsImage*) 0x633e30) out=((VipsImage*) 0x6eb010) vshrink=3.552632 kernel=((VipsKernel) VIPS_KERNEL_LANCZOS3) gap=2.000000 -
VIPS-INFO: 19:59:11.461: residual reduceh by 0.28125
VIPS-INFO: 19:59:11.461: reduceh: 23 point mask
vips cache : copy in=((VipsImage*) 0x6eb010) out=((VipsImage*) 0x6ebb00) -
vips cache+: embed in=((VipsImage*) 0x6ebb00) out=((VipsImage*) 0x6ebc90) x=11 y=0 width=1943 height=34352 extend=((VipsExtend) VIPS_EXTEND_COPY) -
vips cache+: reduceh in=((VipsImage*) 0x6eb010) out=((VipsImage*) 0x6eb970) hshrink=3.555556 kernel=((VipsKernel) VIPS_KERNEL_LANCZOS3) gap=2.000000 -
vips cache+: resize in=((VipsImage*) 0x633980) out=((VipsImage*) 0x633ca0) vscale=0.281481 scale=0.281250 -
VIPS-INFO: 19:59:11.464: unpremultiplying alpha
vips cache : copy in=((VipsImage*) 0x633ca0) out=((VipsImage*) 0x711020) -
vips cache+: unpremultiply in=((VipsImage*) 0x633ca0) out=((VipsImage*) 0x6ebe20) -
vips cache : copy in=((VipsImage*) 0x6ebe20) out=((VipsImage*) 0x711340) -
vips cache+: cast in=((VipsImage*) 0x6ebe20) out=((VipsImage*) 0x7111b0) format=((VipsBandFormat) VIPS_FORMAT_UCHAR) -
vips cache : copy in=((VipsImage*) 0x7111b0) out=((VipsImage*) 0x7114d0) -
vips cache : thumbnail filename="big.webp[n=-1]" out=((VipsImage*) 0x711660) width=540 height=540 size=((VipsSize) VIPS_SIZE_BOTH) no-rotate=FALSE crop=((VipsInteresting) VIPS_INTERESTING_NONE) linear=FALSE import-profile=NULL export-profile=NULL intent=((VipsIntent) VIPS_INTENT_RELATIVE) -
VIPS-INFO: 19:59:11.467: thumbnailing big.webp[n=-1] as ./big540.webp
vips cache+: cast in=((VipsImage*) 0x711660) out=((VipsImage*) 0x7117f0) format=((VipsBandFormat) VIPS_FORMAT_UCHAR) -
vips cache : copy in=((VipsImage*) 0x7117f0) out=((VipsImage*) 0x711980) -
vipsthumbnail temp-26: 540 x 34352 pixels, 10 threads, 540 x 16 tiles, 256 lines in buffer
vips cache+: linecache in=((VipsImage*) 0x711e30) out=((VipsImage*) 0x4044034330) tile-height=1 access=((VipsAccess) VIPS_ACCESS_SEQUENTIAL) -
vips cache+: sequential in=((VipsImage*) 0x711e30) out=((VipsImage*) 0x40440341a0) -
VIPS-INFO: 19:59:11.493: vips__open_image_write: opening with O_TMPFILE
VIPS-INFO: 19:59:11.494: vips__open_image_write: O_TMPFILE failed!
VIPS-INFO: 19:59:11.494: vips__open_image_write: simple open
vipsthumbnail big.webp: 1920 x 122040 pixels, 10 threads, 1920 x 16 tiles, 256 lines in buffer
vipsthumbnail big.webp: done in 16.6s          
vipsthumbnail temp-26: done in 237s          
vips cache : webpsave_target in=((VipsImage*) 0x711660) target=((VipsTarget*) 0x71a000) -
vips_threadset_free: peak of 16 threads
memory: high-water mark 93.50 MB

kipcole9 · 2023-08-07T20:23:49Z

kipcole9
Aug 7, 2023

Maybe Docker or the Linux guest is running in Rosetta mode on the M1 Max?

1 reply

rtio Aug 7, 2023
Author

Nope, but the other Linux isn't a container and it's taking ~25 seconds to run 😭

rtio · 2023-08-14T14:27:46Z

rtio
Aug 14, 2023
Author

Any hint?

5 replies

jcupitt Aug 14, 2023
Maintainer

Maybe the issue is filesystem performance? Docker on macOS runs in a VM and has a thing to map filesystem requests out to the enclosing macOS. Something that does a lot of IO can be very slow.

rtio Aug 14, 2023
Author

At first I thought that, but because of that I tested it on another computer, and it was still very slow:

vipsthumbnail big.webp: 1920 x 122040 pixels, 30 threads, 1920 x 16 tiles, 512 lines in buffer
vipsthumbnail big.webp: done in 6.4s
vipsthumbnail temp-26: done in 18.9s

Linux Intel Xeon Processor 30 core - vips-8.14.3

vipsthumbnail 'big.webp[n=-1]' --vips-progress --vips-info --vips-cache-trace --vips-leak --size 540 -o big540.webp
VIPS-INFO: 15:59:22.948: thumbnailing big.webp[n=-1]
vips cache+: webpload filename="big.webp" out=((VipsImage*) 0xcb21b0) n=-1 flags=((VipsForeignFlags) VIPS_FOREIGN_NONE) -
VIPS-INFO: 15:59:22.949: selected loader is VipsForeignLoadWebpFile
VIPS-INFO: 15:59:22.949: input size is 1920 x 122040
VIPS-INFO: 15:59:22.949: loading with factor 3.55556 pre-shrink
vips cache+: webpload filename="big.webp" out=((VipsImage*) 0xcb24d0) n=-1 scale=0.281250 flags=((VipsForeignFlags) VIPS_FOREIGN_NONE) access=((VipsAccess) VIPS_ACCESS_SEQUENTIAL) fail-on=((VipsFailOn) VIPS_FAIL_ON_NONE) -
VIPS-INFO: 15:59:22.949: pre-shrunk size is 1920 x 122040
VIPS-INFO: 15:59:22.949: converting to processing space srgb
vips cache+: colourspace in=((VipsImage*) 0xcb24d0) out=((VipsImage*) 0xcb27f0) space=((VipsInterpretation) VIPS_INTERPRETATION_sRGB) -
VIPS-INFO: 15:59:22.949: premultiplying alpha
vips cache : copy in=((VipsImage*) 0xcb27f0) out=((VipsImage*) 0xcb2b10) -
vips cache+: premultiply in=((VipsImage*) 0xcb27f0) out=((VipsImage*) 0xcb2980) -
vips cache : copy in=((VipsImage*) 0xcb2980) out=((VipsImage*) 0xcb2e30) -
VIPS-INFO: 15:59:22.950: residual reducev by 0.281481
VIPS-INFO: 15:59:22.950: reducev: 23 point mask
vips cache : copy in=((VipsImage*) 0xcb2e30) out=((VipsImage*) 0xd691a0) -
vips cache+: embed in=((VipsImage*) 0xd691a0) out=((VipsImage*) 0xd69330) x=0 y=11 width=1920 height=122063 extend=((VipsExtend) VIPS_EXTEND_COPY) -
VIPS-INFO: 15:59:22.950: reducev sequential line cache
vips cache+: linecache in=((VipsImage*) 0xd694c0) out=((VipsImage*) 0xd697e0) tile-height=10 access=((VipsAccess) VIPS_ACCESS_SEQUENTIAL) -
vips cache+: sequential in=((VipsImage*) 0xd694c0) out=((VipsImage*) 0xd69650) tile-height=10 -
vips cache+: reducev in=((VipsImage*) 0xcb2e30) out=((VipsImage*) 0xd69010) vshrink=3.552632 kernel=((VipsKernel) VIPS_KERNEL_LANCZOS3) gap=2.000000 -
VIPS-INFO: 15:59:22.950: residual reduceh by 0.28125
VIPS-INFO: 15:59:22.950: reduceh: 23 point mask
vips cache : copy in=((VipsImage*) 0xd69010) out=((VipsImage*) 0xd69b00) -
vips cache+: embed in=((VipsImage*) 0xd69b00) out=((VipsImage*) 0xd69c90) x=11 y=0 width=1943 height=34352 extend=((VipsExtend) VIPS_EXTEND_COPY) -
vips cache+: reduceh in=((VipsImage*) 0xd69010) out=((VipsImage*) 0xd69970) hshrink=3.555556 kernel=((VipsKernel) VIPS_KERNEL_LANCZOS3) gap=2.000000 -
vips cache+: resize in=((VipsImage*) 0xcb2980) out=((VipsImage*) 0xcb2ca0) vscale=0.281481 scale=0.281250 -
VIPS-INFO: 15:59:22.950: unpremultiplying alpha
vips cache : copy in=((VipsImage*) 0xcb2ca0) out=((VipsImage*) 0xd8f020) -
vips cache+: unpremultiply in=((VipsImage*) 0xcb2ca0) out=((VipsImage*) 0xd69e20) -
vips cache : copy in=((VipsImage*) 0xd69e20) out=((VipsImage*) 0xd8f340) -
vips cache+: cast in=((VipsImage*) 0xd69e20) out=((VipsImage*) 0xd8f1b0) format=((VipsBandFormat) VIPS_FORMAT_UCHAR) -
vips cache : copy in=((VipsImage*) 0xd8f1b0) out=((VipsImage*) 0xd8f4d0) -
vips cache : thumbnail filename="big.webp[n=-1]" out=((VipsImage*) 0xd8f660) width=540 height=540 size=((VipsSize) VIPS_SIZE_BOTH) no-rotate=FALSE crop=((VipsInteresting) VIPS_INTERESTING_NONE) linear=FALSE import-profile=NULL export-profile=NULL intent=((VipsIntent) VIPS_INTENT_RELATIVE) -
VIPS-INFO: 15:59:22.951: thumbnailing big.webp[n=-1] as ./big540.webp
vips cache+: cast in=((VipsImage*) 0xd8f660) out=((VipsImage*) 0xd8f7f0) format=((VipsBandFormat) VIPS_FORMAT_UCHAR) -
vips cache : copy in=((VipsImage*) 0xd8f7f0) out=((VipsImage*) 0xd8f980) -
vipsthumbnail temp-26: 540 x 34352 pixels, 30 threads, 540 x 16 tiles, 512 lines in buffer
vips cache+: linecache in=((VipsImage*) 0xd8fe30) out=((VipsImage*) 0x7f17d4033330) tile-height=1 access=((VipsAccess) VIPS_ACCESS_SEQUENTIAL) -
vips cache+: sequential in=((VipsImage*) 0xd8fe30) out=((VipsImage*) 0x7f17d40331a0) -
VIPS-INFO: 15:59:23.006: vips__open_image_write: opening with O_TMPFILE
VIPS-INFO: 15:59:23.006: vips__open_image_write: O_TMPFILE failed!
VIPS-INFO: 15:59:23.006: vips__open_image_write: simple open
vipsthumbnail big.webp: 1920 x 122040 pixels, 30 threads, 1920 x 16 tiles, 512 lines in buffer
vipsthumbnail big.webp: done in 6.4s
vipsthumbnail temp-26: done in 18.9s
vips cache : webpsave_target in=((VipsImage*) 0xd8f660) target=((VipsTarget*) 0xd98000) -
vips_threadset_free: peak of 36 threads
memory: high-water mark 132.59 MB

kleisauke Aug 14, 2023
Collaborator

Perhaps using the --vips-novector flag or setting the VIPS_NOVECTOR=1 env variable would help?

rtio Aug 14, 2023
Author

Not much difference:

➜ vipsthumbnail 'big.webp[n=-1]' --vips-progress --size 540 -o big540.webp
vipsthumbnail temp-26: 540 x 34352 pixels, 30 threads, 540 x 16 tiles, 512 lines in buffer
vipsthumbnail big.webp: 1920 x 122040 pixels, 30 threads, 1920 x 16 tiles, 512 lines in buffer
vipsthumbnail big.webp: done in 6.24s
vipsthumbnail temp-26: done in 19s
➜ vipsthumbnail 'big.webp[n=-1]' --vips-progress --vips-novector --size 540 -o big540.webp
vipsthumbnail temp-26: 540 x 34352 pixels, 30 threads, 540 x 16 tiles, 512 lines in buffer
vipsthumbnail big.webp: 1920 x 122040 pixels, 30 threads, 1920 x 16 tiles, 512 lines in buffer
vipsthumbnail big.webp: done in 5.68s
vipsthumbnail temp-26: done in 18.6s

rtio Aug 16, 2023
Author

@jcupitt if you inspect the image I provided it has different frame sizes, I'm wondering if that is causing the slowness, for other animated WebP images vipsthumbnail run quite fast:

magick identify big.webp
big.webp[0] WEBP 1920x1080 1920x1080+0+0 8-bit sRGB 4.85483MiB 1.240u 0:01.248
big.webp[1] WEBP 1920x1046 1920x1080+0+0 8-bit sRGB 1.230u 0:01.228
big.webp[2] WEBP 1918x966 1920x1080+0+36 8-bit sRGB 1.210u 0:01.214
big.webp[3] WEBP 1920x994 1920x1080+0+8 8-bit sRGB 1.210u 0:01.204
big.webp[4] WEBP 1920x1044 1920x1080+0+0 8-bit sRGB 1.190u 0:01.192
big.webp[5] WEBP 1920x970 1920x1080+0+0 8-bit sRGB 1.170u 0:01.181
big.webp[6] WEBP 1920x1030 1920x1080+0+2 8-bit sRGB 1.160u 0:01.170
big.webp[7] WEBP 1920x1032 1920x1080+0+0 8-bit sRGB 1.150u 0:01.159
big.webp[8] WEBP 1920x992 1920x1080+0+6 8-bit sRGB 1.140u 0:01.147
big.webp[9] WEBP 1920x1026 1920x1080+0+0 8-bit sRGB 1.130u 0:01.136
big.webp[10] WEBP 1920x1032 1920x1080+0+0 8-bit sRGB 1.120u 0:01.125
big.webp[11] WEBP 1920x967 1920x1080+0+0 8-bit sRGB 1.110u 0:01.112
big.webp[12] WEBP 1920x932 1920x1080+0+34 8-bit sRGB 1.100u 0:01.102
big.webp[13] WEBP 1920x1032 1920x1080+0+0 8-bit sRGB 1.090u 0:01.092
big.webp[14] WEBP 1920x1005 1920x1080+0+8 8-bit sRGB 1.080u 0:01.080
big.webp[15] WEBP 1920x1027 1920x1080+0+0 8-bit sRGB 1.070u 0:01.069
big.webp[16] WEBP 1920x1040 1920x1080+0+0 8-bit sRGB 1.050u 0:01.057
big.webp[17] WEBP 1920x1026 1920x1080+0+4 8-bit sRGB 1.040u 0:01.045
big.webp[18] WEBP 1920x959 1920x1080+0+6 8-bit sRGB 1.030u 0:01.033
big.webp[19] WEBP 1920x1010 1920x1080+0+8 8-bit sRGB 1.020u 0:01.022
big.webp[20] WEBP 1920x1016 1920x1080+0+0 8-bit sRGB 1.010u 0:01.011
big.webp[21] WEBP 1920x1023 1920x1080+0+0 8-bit sRGB 1.000u 0:01.000
big.webp[22] WEBP 1920x1009 1920x1080+0+0 8-bit sRGB 0.990u 0:00.988
big.webp[23] WEBP 1916x981 1920x1080+4+42 8-bit sRGB 0.980u 0:00.976
big.webp[24] WEBP 1908x959 1920x1080+0+40 8-bit sRGB 0.970u 0:00.965
big.webp[25] WEBP 1920x1022 1920x1080+0+2 8-bit sRGB 0.950u 0:00.955
big.webp[26] WEBP 1914x1030 1920x1080+6+2 8-bit sRGB 0.940u 0:00.944
big.webp[27] WEBP 1920x1002 1920x1080+0+30 8-bit sRGB 0.930u 0:00.932
big.webp[28] WEBP 1920x1035 1920x1080+0+0 8-bit sRGB 0.920u 0:00.921
big.webp[29] WEBP 1920x969 1920x1080+0+0 8-bit sRGB 0.910u 0:00.910
big.webp[30] WEBP 1920x965 1920x1080+0+2 8-bit sRGB 0.900u 0:00.899
big.webp[31] WEBP 1920x971 1920x1080+0+26 8-bit sRGB 0.890u 0:00.889
big.webp[32] WEBP 1918x1030 1920x1080+2+2 8-bit sRGB 0.880u 0:00.878
big.webp[33] WEBP 1920x996 1920x1080+0+2 8-bit sRGB 0.870u 0:00.866
big.webp[34] WEBP 1920x988 1920x1080+0+0 8-bit sRGB 0.860u 0:00.856
big.webp[35] WEBP 1914x1006 1920x1080+6+2 8-bit sRGB 0.850u 0:00.845
big.webp[36] WEBP 1920x971 1920x1080+0+4 8-bit sRGB 0.830u 0:00.834
big.webp[37] WEBP 1920x1016 1920x1080+0+0 8-bit sRGB 0.820u 0:00.823
big.webp[38] WEBP 1920x1032 1920x1080+0+0 8-bit sRGB 0.810u 0:00.812
big.webp[39] WEBP 1920x987 1920x1080+0+20 8-bit sRGB 0.800u 0:00.801
big.webp[40] WEBP 1883x937 1920x1080+12+12 8-bit sRGB 0.790u 0:00.790
big.webp[41] WEBP 1920x1026 1920x1080+0+6 8-bit sRGB 0.780u 0:00.781
big.webp[42] WEBP 1920x992 1920x1080+0+0 8-bit sRGB 0.770u 0:00.770
big.webp[43] WEBP 1920x961 1920x1080+0+28 8-bit sRGB 0.760u 0:00.760
big.webp[44] WEBP 1920x1020 1920x1080+0+4 8-bit sRGB 0.750u 0:00.749
big.webp[45] WEBP 1920x1030 1920x1080+0+2 8-bit sRGB 0.740u 0:00.738
big.webp[46] WEBP 1920x1022 1920x1080+0+2 8-bit sRGB 0.730u 0:00.726
big.webp[47] WEBP 1920x984 1920x1080+0+32 8-bit sRGB 0.720u 0:00.715
big.webp[48] WEBP 1920x965 1920x1080+0+2 8-bit sRGB 0.700u 0:00.704
big.webp[49] WEBP 1920x1031 1920x1080+0+0 8-bit sRGB 0.690u 0:00.693
big.webp[50] WEBP 1920x985 1920x1080+0+32 8-bit sRGB 0.680u 0:00.682
big.webp[51] WEBP 1920x1002 1920x1080+0+0 8-bit sRGB 0.670u 0:00.671
big.webp[52] WEBP 1911x1004 1920x1080+4+20 8-bit sRGB 0.660u 0:00.659
big.webp[53] WEBP 1920x943 1920x1080+0+24 8-bit sRGB 0.650u 0:00.650
big.webp[54] WEBP 1920x996 1920x1080+0+20 8-bit sRGB 0.640u 0:00.640
big.webp[55] WEBP 1920x1031 1920x1080+0+0 8-bit sRGB 0.630u 0:00.629
big.webp[56] WEBP 1920x1012 1920x1080+0+4 8-bit sRGB 0.620u 0:00.617
big.webp[57] WEBP 1912x1016 1920x1080+8+0 8-bit sRGB 0.610u 0:00.606
big.webp[58] WEBP 1912x1016 1920x1080+8+0 8-bit sRGB 0.590u 0:00.595
big.webp[59] WEBP 1920x1013 1920x1080+0+10 8-bit sRGB 0.580u 0:00.584
big.webp[60] WEBP 1919x968 1920x1080+0+0 8-bit sRGB 0.570u 0:00.573
big.webp[61] WEBP 1920x1031 1920x1080+0+0 8-bit sRGB 0.560u 0:00.562
big.webp[62] WEBP 1920x1002 1920x1080+0+0 8-bit sRGB 0.550u 0:00.551
big.webp[63] WEBP 1920x958 1920x1080+0+18 8-bit sRGB 0.540u 0:00.540
big.webp[64] WEBP 1910x1018 1920x1080+0+10 8-bit sRGB 0.530u 0:00.529
big.webp[65] WEBP 1920x1024 1920x1080+0+0 8-bit sRGB 0.520u 0:00.519
big.webp[66] WEBP 1920x1008 1920x1080+0+0 8-bit sRGB 0.510u 0:00.508
big.webp[67] WEBP 1920x1032 1920x1080+0+0 8-bit sRGB 0.500u 0:00.498
big.webp[68] WEBP 1920x1006 1920x1080+0+2 8-bit sRGB 0.490u 0:00.486
big.webp[69] WEBP 1920x969 1920x1080+0+6 8-bit sRGB 0.470u 0:00.475
big.webp[70] WEBP 1920x991 1920x1080+0+0 8-bit sRGB 0.460u 0:00.465
big.webp[71] WEBP 1920x1030 1920x1080+0+0 8-bit sRGB 0.450u 0:00.454
big.webp[72] WEBP 1920x1000 1920x1080+0+32 8-bit sRGB 0.440u 0:00.443
big.webp[73] WEBP 1920x1032 1920x1080+0+0 8-bit sRGB 0.430u 0:00.432
big.webp[74] WEBP 1920x1032 1920x1080+0+0 8-bit sRGB 0.420u 0:00.421
big.webp[75] WEBP 1920x1024 1920x1080+0+8 8-bit sRGB 0.410u 0:00.410
big.webp[76] WEBP 1442x766 1920x1080+24+34 8-bit sRGB 0.400u 0:00.398
big.webp[77] WEBP 1920x1030 1920x1080+0+2 8-bit sRGB 0.390u 0:00.393
big.webp[78] WEBP 1920x1001 1920x1080+0+30 8-bit sRGB 0.380u 0:00.382
big.webp[79] WEBP 1912x959 1920x1080+8+8 8-bit sRGB 0.370u 0:00.371
big.webp[80] WEBP 1920x1030 1920x1080+0+0 8-bit sRGB 0.350u 0:00.360
big.webp[81] WEBP 1920x1030 1920x1080+0+0 8-bit sRGB 0.340u 0:00.349
big.webp[82] WEBP 1920x984 1920x1080+0+24 8-bit sRGB 0.330u 0:00.337
big.webp[83] WEBP 1888x971 1920x1080+32+44 8-bit sRGB 0.320u 0:00.326
big.webp[84] WEBP 1920x1001 1920x1080+0+8 8-bit sRGB 0.310u 0:00.316
big.webp[85] WEBP 1920x1029 1920x1080+0+2 8-bit sRGB 0.300u 0:00.305
big.webp[86] WEBP 1920x1002 1920x1080+0+30 8-bit sRGB 0.290u 0:00.293
big.webp[87] WEBP 1920x1016 1920x1080+0+8 8-bit sRGB 0.280u 0:00.282
big.webp[88] WEBP 1696x779 1920x1080+68+92 8-bit sRGB 0.270u 0:00.271
big.webp[89] WEBP 1920x990 1920x1080+0+2 8-bit sRGB 0.270u 0:00.264
big.webp[90] WEBP 1920x1022 1920x1080+0+10 8-bit sRGB 0.260u 0:00.253
big.webp[91] WEBP 1920x1032 1920x1080+0+0 8-bit sRGB 0.240u 0:00.242
big.webp[92] WEBP 1918x1022 1920x1080+2+10 8-bit sRGB 0.230u 0:00.231
big.webp[93] WEBP 1920x992 1920x1080+0+0 8-bit sRGB 0.210u 0:00.219
big.webp[94] WEBP 1920x1032 1920x1080+0+0 8-bit sRGB 0.200u 0:00.208
big.webp[95] WEBP 1920x990 1920x1080+0+2 8-bit sRGB 0.190u 0:00.198
big.webp[96] WEBP 1920x1023 1920x1080+0+8 8-bit sRGB 0.180u 0:00.187
big.webp[97] WEBP 1920x1007 1920x1080+0+0 8-bit sRGB 0.170u 0:00.176
big.webp[98] WEBP 1920x1005 1920x1080+0+2 8-bit sRGB 0.160u 0:00.165
big.webp[99] WEBP 1920x1022 1920x1080+0+10 8-bit sRGB 0.150u 0:00.154
big.webp[100] WEBP 1777x712 1920x1080+78+222 8-bit sRGB 0.140u 0:00.143
big.webp[101] WEBP 1920x992 1920x1080+0+0 8-bit sRGB 0.140u 0:00.137
big.webp[102] WEBP 1920x1030 1920x1080+0+2 8-bit sRGB 0.130u 0:00.126
big.webp[103] WEBP 1920x1032 1920x1080+0+0 8-bit sRGB 0.120u 0:00.115
big.webp[104] WEBP 1920x968 1920x1080+0+0 8-bit sRGB 0.100u 0:00.104
big.webp[105] WEBP 1920x1032 1920x1080+0+0 8-bit sRGB 0.090u 0:00.094
big.webp[106] WEBP 1920x992 1920x1080+0+0 8-bit sRGB 0.080u 0:00.082
big.webp[107] WEBP 1920x983 1920x1080+0+24 8-bit sRGB 0.070u 0:00.071
big.webp[108] WEBP 1904x1023 1920x1080+16+8 8-bit sRGB 0.060u 0:00.060
big.webp[109] WEBP 1920x984 1920x1080+0+24 8-bit sRGB 0.050u 0:00.049
big.webp[110] WEBP 1918x982 1920x1080+2+10 8-bit sRGB 0.040u 0:00.038
big.webp[111] WEBP 1920x957 1920x1080+0+10 8-bit sRGB 0.030u 0:00.027
big.webp[112] WEBP 1920x1008 1920x1080+0+0 8-bit sRGB 0.020u 0:00.016

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

vipsthumbnail takes too long to process WebP animated image #3596

{{title}}

Replies: 2 comments 6 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

Select a reply

vipsthumbnail takes too long to process WebP animated image #3596

rtio Aug 7, 2023

Mac M1 Max - vips-8.14.3

Linux Intel Xeon Processor 30 core - vips-8.14.3

Docker container running over the same Mac M1 Max - vips-8.14.3

Replies: 2 comments · 6 replies

kipcole9 Aug 7, 2023

rtio Aug 7, 2023 Author

rtio Aug 14, 2023 Author

jcupitt Aug 14, 2023 Maintainer

rtio Aug 14, 2023 Author

Linux Intel Xeon Processor 30 core - vips-8.14.3

kleisauke Aug 14, 2023 Collaborator

rtio Aug 14, 2023 Author

rtio Aug 16, 2023 Author

rtio
Aug 7, 2023

Replies: 2 comments 6 replies

kipcole9
Aug 7, 2023

rtio Aug 7, 2023
Author

rtio
Aug 14, 2023
Author

jcupitt Aug 14, 2023
Maintainer

rtio Aug 14, 2023
Author

kleisauke Aug 14, 2023
Collaborator

rtio Aug 14, 2023
Author

rtio Aug 16, 2023
Author