Add benchmark tests by akx · Pull Request #9654 · python-pillow/Pillow

akx · 2026-06-03T07:36:52Z

Related to #9649 and python-pillow/pillow-perf#161.

This PR ports most Pillow-related tests from pillow-perf, modernized (no more compatibility with ancient versions of Pillow), converted to pytest-benchmark style, and also jams in the blend benchmark I used to measure #9649's impact.

The file lives under Tests/, as it is a pytest file (and some benchmarks use test fixture images), but is not named test_*, so it will not be automatically collected as a test (and nothing untoward should happen if you don't have pytest-benchmark installed).

The second commit in this PR wires benchmarks into CI after successful tests.

On my Macbook, running the whole benchmark suite takes about 200 seconds right now -- in CI, this could be adjusted with e.g. --benchmark-max-time at the possible expense of measurement fidelity. Also, some of the benchmarks are currently somewhat exhaustive (combinatorial parametrizes). EDIT: Ugh, about 5 minutes (so longer than the test suite) in CI 😅

radarhere · 2026-06-06T08:33:39Z

You are only running this in our Test jobs, not others. I'm guessing you did that because you didn't want to slow down all of our CI jobs?

akx · 2026-06-09T09:21:34Z

You are only running this in our Test jobs, not others. I'm guessing you did that because you didn't want to slow down all of our CI jobs?

Yep, exactly. Since building Pillow from source doesn't actually seem to take that long, maybe it'd be worth it to split it to a separate build + benchmark only job that's run on a single "known" (given these are GHA cloud runners, we may really never know, and neighbors may be noisy) platform?

hugovk

Thanks for this!

The benchmark runs are pretty slow, especially for PyPy, which means the end-to-end time for the workflow goes from ~12 mins to ~40 mins.

Job	main	PR	Delta	Factor
ubuntu 3.10	2m57s	9m35s	+6m38s	3.2x
ubuntu 3.11	3m36s	9m32s	+5m56s	2.6x
ubuntu 3.12	3m14s	9m16s	+6m02s	2.9x
ubuntu 3.13	3m20s	9m21s	+6m01s	2.8x
ubuntu 3.14	3m02s	9m04s	+6m02s	3.0x
ubuntu 3.14t	3m02s	8m54s	+5m52s	2.9x
ubuntu 3.15	2m59s	9m28s	+6m29s	3.2x
ubuntu 3.15t	3m15s	8m51s	+5m36s	2.7x
ubuntu pypy3.11	8m46s	27m13s	+18m27s	3.1x
macos 3.11	3m58s	9m30s	+5m32s	2.4x
macos 3.12	3m07s	8m46s	+5m39s	2.8x
macos 3.13	3m07s	10m01s	+6m54s	3.2x
macos 3.14	3m03s	9m11s	+6m08s	3.0x
macos 3.14t	4m15s	8m58s	+4m43s	2.1x
macos 3.15	3m55s	9m57s	+6m02s	2.5x
macos 3.15t	3m56s	11m57s	+8m01s	3.0x
macos pypy3.11	7m58s	31m00s	+23m02s	3.9x
macos-26-intel 3.10	7m18s	17m15s	+9m57s	2.4x

Do we need to benchmark every version?

Also, this is benchmarking on noisy GHA runners, which might not be as reliable.

Should we use https://codspeed.io/ instead? My understanding is they have two approaches: one is to benchmark the real wall-time on their quiet servers, but there's a quota of 600 minutes per month for open source.

The other is to benchmark on GHA using pytest-codspeed, which uses a Valgrind/Cachegrind CPU simulator, where server noise is less an issue. It's slower, but does a single pass rather than many rounds, so might be quicker.

With both, we can see and compare results on their website, a bit like Codecov.

Again, we might not want to benchmark every version?

hugovk · 2026-06-17T14:36:05Z

+    - name: Upload benchmarks
+      uses: actions/upload-artifact@043fb46d1a93c77aae656e7c1c64a875d1fc6a0a # v7.0.1
+      with:
+        name: benchmarks-${{ matrix.os }}-${{ matrix.python-version }}
+        path: .benchmarks


This isn't working:

Warning: No files were found with the provided path: .benchmarks. No artifacts will be uploaded.

https://github.com/python-pillow/Pillow/actions/runs/27641704795/job/81743138114

akx · 2026-06-17T16:19:10Z

The benchmark runs are pretty slow, especially for PyPy, which means the end-to-end time for the workflow goes from ~12 mins to ~40 mins.
Also, this is benchmarking on noisy GHA runners, which might not be as reliable.

Yep, noted above. :)

Should we use https://codspeed.io/ instead? My understanding is they have two approaches: one is to benchmark the real wall-time on their quiet servers, but there's a quota of 600 minutes per month for open source.

That's a possibility - happily, it looks like the pytest-benchmark benchmark fixture and pytest-codspeed benchmark fixture have the same signature. (I haven't used pytest-codspeed myself though.)

Again, we might not want to benchmark every version?

I rebased things and disabled the run-in-CI commit's guts for now; it's there but commented out pending a decision.

hugovk · 2026-06-17T18:18:03Z

Let's try it, I've enabled this repo on Codspeed:

https://app.codspeed.io/python-pillow/Pillow

Setup info:

Create benchmarks
Create or update your existing benchmarks and install the CodSpeed integration in your language. Check out the docs on Creating benchmarks
Setup CI workflow
Create or update a GitHub Actions workflow to run CodSpeed, and open a pull request to trigger a first run.
Merge to default branch
Merge the installation pull request on your default branch to receive detailed performance reports in each pull request.

Co-authored-by: Hugo van Kemenade <1324225+hugovk@users.noreply.github.com>

akx · 2026-06-29T08:27:25Z

@hugovk Wired up CodSpeed: 3e91b4b

akx · 2026-06-29T09:55:34Z

I'll let at least one of the codspeeds run to completion to see that results get uploaded correctly, then refactor these into a separate workflow file that runs independent of the test cycle on a more limited set of interpreters.

codspeed-hq · 2026-06-29T10:02:53Z

Congrats! CodSpeed is installed 🎉

🆕 331 new benchmarks were detected.

You will start to see performance impacts in the reports once the benchmarks are run from your default branch.

Detected benchmarks

test_allocate[1024x1024-L]: 573.9 µs
test_allocate[1024x1024-LA]: 4.3 ms
test_allocate[1024x1024-RGB]: 4.3 ms
test_allocate[1024x1024-RGBA]: 4.3 ms
test_alpha_composition[1024x1024-LA]: 26.8 ms
test_alpha_composition[1024x1024-RGBA]: 26.8 ms
test_blend[1024x1024-L]: 7 ms
test_blend[1024x1024-LA]: 28 ms
test_blend[1024x1024-RGB]: 28 ms
test_blend[1024x1024-RGBA]: 28 ms
test_box_blur[1024x1024-L-1]: 25.1 ms
test_box_blur[1024x1024-L-10]: 25.1 ms
test_box_blur[1024x1024-L-30]: 25 ms
test_box_blur[1024x1024-LA-1]: 58.2 ms
test_box_blur[1024x1024-LA-10]: 58.4 ms
test_box_blur[1024x1024-LA-30]: 58.4 ms
test_box_blur[1024x1024-RGB-1]: 58.2 ms
test_box_blur[1024x1024-RGB-10]: 58.4 ms
test_box_blur[1024x1024-RGB-30]: 58.4 ms
test_box_blur[1024x1024-RGBA-1]: 58.3 ms
...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

akx · 2026-06-29T10:08:05Z

Per Codspeed's comment

At least one benchmark was run multiple times in your benchmarking workflow. This could be because you used a matrix that runs your benchmarks multiple times.
This behavior is not yet supported, so CodSpeed was unable to generate a performance report.

I changed the new benchmark CI workflow to just run on ubuntu-latest+py3.14.

akx · 2026-06-29T11:04:09Z

@hugovk All green now 👍

hugovk

Thanks!

hugovk · 2026-06-29T13:23:45Z

+
+    - name: Run CodSpeed benchmarks
+      uses: CodSpeedHQ/action@a4a36bb07c0638b0b4ca52bf1f3dad1b4289e52f # v4.18.1
+      if: ${{ matrix.os == 'ubuntu-latest' }}


Redundant:

Suggested change

if: ${{ matrix.os == 'ubuntu-latest' }}

radarhere · 2026-06-29T14:12:01Z

+          "pyproject.toml"
+
+    - name: Cache libavif
+      if: startsWith(matrix.os, 'ubuntu')


Suggested change

if: startsWith(matrix.os, 'ubuntu')

radarhere · 2026-06-29T14:12:11Z

+        key: ${{ runner.os }}-libavif-${{ hashFiles('depends/install_libavif.sh', 'depends/libavif-svt4.patch') }}
+
+    - name: Cache libimagequant
+      if: startsWith(matrix.os, 'ubuntu')


Suggested change

if: startsWith(matrix.os, 'ubuntu')

radarhere · 2026-06-29T14:12:20Z

+        key: ${{ runner.os }}-libimagequant-${{ hashFiles('depends/install_imagequant.sh') }}
+
+    - name: Cache libwebp
+      if: startsWith(matrix.os, 'ubuntu')


Suggested change

if: startsWith(matrix.os, 'ubuntu')

radarhere · 2026-06-29T14:12:34Z

+        key: ${{ runner.os }}-libwebp-${{ hashFiles('depends/install_webp.sh') }}
+
+    - name: Install Linux dependencies
+      if: startsWith(matrix.os, 'ubuntu')


Suggested change

if: startsWith(matrix.os, 'ubuntu')

akx · 2026-06-29T14:26:06Z

I'd keep the (redundant, yes) if: startsWith(matrix.os, 'ubuntu') stanzas in the YAML, because it makes it that much easier to copy-paste from the test workflow if they change.

Co-authored-by: Hugo van Kemenade <1324225+hugovk@users.noreply.github.com>

hugovk · 2026-07-01T13:30:02Z

CodSpeed settings:

I've updated it to only comment when there's a change (improvement, regression or drop).

This PR contains the following updates: | Package | Change | [Age](https://docs.renovatebot.com/merge-confidence/) | [Confidence](https://docs.renovatebot.com/merge-confidence/) | |---|---|---|---| | [pillow](https://github.com/python-pillow/Pillow) ([changelog](https://github.com/python-pillow/Pillow/releases)) | `<12.2.1,>=12.2.0` → `<12.3.1,>=12.3.0` | ![age](https://developer.mend.io/api/mc/badges/age/pypi/pillow/12.3.0?slim=true) | ![confidence](https://developer.mend.io/api/mc/badges/confidence/pypi/pillow/12.2.0/12.3.0?slim=true) | --- ### Release Notes <details> <summary>python-pillow/Pillow (pillow)</summary> ### [`v12.3.0`](https://github.com/python-pillow/Pillow/releases/tag/12.3.0) [Compare Source](python-pillow/Pillow@12.2.0...12.3.0) <https://pillow.readthedocs.io/en/stable/releasenotes/12.3.0.html> #### Removals - Remove non-image ImageCms modes [#9697](python-pillow/Pillow#9697) \[[@radarhere](https://github.com/radarhere)] #### Documentation - Add release notes for SBOM and performance improvements [#9747](python-pillow/Pillow#9747) \[[@radarhere](https://github.com/radarhere)] - Add security release notes [#9741](python-pillow/Pillow#9741) \[[@radarhere](https://github.com/radarhere)] - Add release notes for Python 3.15 beta wheels [#9696](python-pillow/Pillow#9696) \[[@radarhere](https://github.com/radarhere)] - ImageFont can also be used with ImageText [#9597](python-pillow/Pillow#9597) \[[@radarhere](https://github.com/radarhere)] - Additional guidelines for security reports [#9659](python-pillow/Pillow#9659) \[[@wiredfool](https://github.com/wiredfool)] - Fixed typo [#9636](python-pillow/Pillow#9636) \[[@radarhere](https://github.com/radarhere)] - Added CVEs to 12.2.0 release notes [#9591](python-pillow/Pillow#9591) \[[@radarhere](https://github.com/radarhere)] - Revise development support information in README [#9583](python-pillow/Pillow#9583) \[[@aclark4life](https://github.com/aclark4life)] - Add INCIDENT\_RESPONSE.md [#9555](python-pillow/Pillow#9555) \[[@aclark4life](https://github.com/aclark4life)] - Add STRIDE threat model to security docs [#9562](python-pillow/Pillow#9562) \[[@aclark4life](https://github.com/aclark4life)] - Add CVEs to 12.2.0 release notes [#9556](python-pillow/Pillow#9556) \[[@radarhere](https://github.com/radarhere)] - Update README with revised security policy [#9553](python-pillow/Pillow#9553) \[[@radarhere](https://github.com/radarhere)] - Update security policy [#9552](python-pillow/Pillow#9552) \[[@aclark4life](https://github.com/aclark4life)] - Update macOS tested Python versions [#9534](python-pillow/Pillow#9534) \[[@radarhere](https://github.com/radarhere)] #### Dependencies - Update dependency harfbuzz to v14.2.1 [#9720](python-pillow/Pillow#9720) \[@[renovate\[bot\]](https://github.com/apps/renovate)] - Update dependency mypy to v2 [#9653](python-pillow/Pillow#9653) \[@[renovate\[bot\]](https://github.com/apps/renovate)] - Update dependency cibuildwheel to v4 [#9665](python-pillow/Pillow#9665) \[@[renovate\[bot\]](https://github.com/apps/renovate)] - Update github-actions [#9655](python-pillow/Pillow#9655) \[@[renovate\[bot\]](https://github.com/apps/renovate)] - Update dependency libavif to v1.4.2 [#9652](python-pillow/Pillow#9652) \[@[renovate\[bot\]](https://github.com/apps/renovate)] - Update dependency lcms2 to v2.19.1 [#9651](python-pillow/Pillow#9651) \[@[renovate\[bot\]](https://github.com/apps/renovate)] - Update dependency check-jsonschema to v0.37.2 [#9650](python-pillow/Pillow#9650) \[@[renovate\[bot\]](https://github.com/apps/renovate)] - Update google/oss-fuzz digest to [`d872252`](python-pillow/Pillow@d872252) [#9614](python-pillow/Pillow#9614) \[@[renovate\[bot\]](https://github.com/apps/renovate)] - Update dependency lcms2 to v2.19 [#9609](python-pillow/Pillow#9609) \[@[renovate\[bot\]](https://github.com/apps/renovate)] - Update dependency libpng to v1.6.58 - autoclosed [#9608](python-pillow/Pillow#9608) \[@[renovate\[bot\]](https://github.com/apps/renovate)] - Update dependency harfbuzz to v14 [#9610](python-pillow/Pillow#9610) \[@[renovate\[bot\]](https://github.com/apps/renovate)] - Update dependency mypy to v1.20.2 [#9599](python-pillow/Pillow#9599) \[@[renovate\[bot\]](https://github.com/apps/renovate)] - Update github-actions [#9611](python-pillow/Pillow#9611) \[@[renovate\[bot\]](https://github.com/apps/renovate)] - Update dependency cibuildwheel to v3.4.1 [#9607](python-pillow/Pillow#9607) \[@[renovate\[bot\]](https://github.com/apps/renovate)] - Move dependency versions to single JSON and enable Renovate [#9559](python-pillow/Pillow#9559) \[[@hugovk](https://github.com/hugovk)] - Updated raqm to 0.10.5 [#9557](python-pillow/Pillow#9557) \[[@radarhere](https://github.com/radarhere)] - Update dependency cibuildwheel to v3.4.0 [#9532](python-pillow/Pillow#9532) \[@[renovate\[bot\]](https://github.com/apps/renovate)] #### Testing - Remove matrix.os from benchmark [#9735](python-pillow/Pillow#9735) \[[@radarhere](https://github.com/radarhere)] - Remove references to libavif patch [#9734](python-pillow/Pillow#9734) \[[@radarhere](https://github.com/radarhere)] - Add benchmark tests [#9654](python-pillow/Pillow#9654) \[[@akx](https://github.com/akx)] - Use reshape() instead of setting NumPy array shape directly [#9728](python-pillow/Pillow#9728) \[[@radarhere](https://github.com/radarhere)] - Add dependencies.json to Windows cache key [#9721](python-pillow/Pillow#9721) \[[@radarhere](https://github.com/radarhere)] - Increase AVIF test epsilon for loong64 [#9714](python-pillow/Pillow#9714) \[[@wszqkzqk](https://github.com/wszqkzqk)] - Add colour to Linux and Windows wheel build logs [#9677](python-pillow/Pillow#9677) \[[@hugovk](https://github.com/hugovk)] - Do not test NumPy against Python 3.15 Windows AMD64 wheels [#9674](python-pillow/Pillow#9674) \[[@radarhere](https://github.com/radarhere)] - Run pyroma in `tox -e lint` instead of pytest [#9670](python-pillow/Pillow#9670) \[[@hugovk](https://github.com/hugovk)] - Update Ghostscript to 10.7.1 [#9634](python-pillow/Pillow#9634) \[[@radarhere](https://github.com/radarhere)] - Update free-threading CI [#9625](python-pillow/Pillow#9625) \[[@hugovk](https://github.com/hugovk)] - Increase AVIF test epsilon for riscv64 [#9606](python-pillow/Pillow#9606) \[[@radarhere](https://github.com/radarhere)] - Add Fedora 44 [#9594](python-pillow/Pillow#9594) \[[@radarhere](https://github.com/radarhere)] - Test Ubuntu 26.04 LTS (Resolute Raccoon) [#9587](python-pillow/Pillow#9587) \[[@hugovk](https://github.com/hugovk)] - Skip EPS test\_1 for Ghostscript 10.06.0 [#9588](python-pillow/Pillow#9588) \[[@radarhere](https://github.com/radarhere)] - Catch subprocess.CalledProcessError in test\_grab\_x11 [#9578](python-pillow/Pillow#9578) \[[@radarhere](https://github.com/radarhere)] - Correct feature name [#9542](python-pillow/Pillow#9542) \[[@radarhere](https://github.com/radarhere)] - Skip test if FreeType is not available [#9540](python-pillow/Pillow#9540) \[[@radarhere](https://github.com/radarhere)] - Remove type hint ignore [#9538](python-pillow/Pillow#9538) \[[@radarhere](https://github.com/radarhere)] - Update macOS tested Python versions [#9534](python-pillow/Pillow#9534) \[[@radarhere](https://github.com/radarhere)] - Remove Debian 12 and Fedora 42 from CI [#9530](python-pillow/Pillow#9530) \[[@hugovk](https://github.com/hugovk)] - Remove manylinux2014 and Amazon Linux 2 [#9528](python-pillow/Pillow#9528) \[[@radarhere](https://github.com/radarhere)] #### Type hints - Use NumPy 2.4.6 for mypy [#9705](python-pillow/Pillow#9705) \[[@radarhere](https://github.com/radarhere)] - Update dependency mypy to v2 [#9653](python-pillow/Pillow#9653) \[@[renovate\[bot\]](https://github.com/apps/renovate)] - Update putpixel type hint to allow lists in xy [#9585](python-pillow/Pillow#9585) \[[@radarhere](https://github.com/radarhere)] - Remove type hint ignore [#9538](python-pillow/Pillow#9538) \[[@radarhere](https://github.com/radarhere)] #### Other changes - Speed up ImageChops operations [#9738](python-pillow/Pillow#9738) \[[@akx](https://github.com/akx)] - Speed up `Image.filter()` [#9736](python-pillow/Pillow#9736) \[[@akx](https://github.com/akx)] - Speed up `Image.getchannel()`, `Image.merge()`, `Image.putalpha()` and `Image.split()` [#9675](python-pillow/Pillow#9675) \[[@akx](https://github.com/akx)] - Speed up `Image.fill()`, `Image.linear_gradient()` and `Image.radial_gradient()`. [#9737](python-pillow/Pillow#9737) \[[@akx](https://github.com/akx)] - Speed up `Image.resample()` [#9739](python-pillow/Pillow#9739) \[[@akx](https://github.com/akx)] - Speed up `alpha_composite`, `matrix`, `negative`, `quantize` [#9740](python-pillow/Pillow#9740) \[[@akx](https://github.com/akx)] - Remove PyErr\_Clear() of "weird" exceptions [#9730](python-pillow/Pillow#9730) \[[@radarhere](https://github.com/radarhere)] - Check realloc return value [#9722](python-pillow/Pillow#9722) \[[@radarhere](https://github.com/radarhere)] - Add max\_length to PdfStream decode() [#9718](python-pillow/Pillow#9718) \[[@radarhere](https://github.com/radarhere)] - Return early when there is no fill region [#9732](python-pillow/Pillow#9732) \[[@radarhere](https://github.com/radarhere)] - Allow error to be raised if PyDict\_SetItemString fails [#9731](python-pillow/Pillow#9731) \[[@radarhere](https://github.com/radarhere)] - Speed up `Image.blend()` [#9649](python-pillow/Pillow#9649) \[[@akx](https://github.com/akx)] - Raise OverflowError if number of vertices is too large for Path [#9729](python-pillow/Pillow#9729) \[[@radarhere](https://github.com/radarhere)] - Remove unused HSV and LAB matrix conversion from C [#9724](python-pillow/Pillow#9724) \[[@radarhere](https://github.com/radarhere)] - Prevent reusing ImagingDecoderObject.setimage [#9656](python-pillow/Pillow#9656) \[[@Serotav](https://github.com/Serotav)] - Raise ValueError if FPX tile size is not 64px by 64px [#9660](python-pillow/Pillow#9660) \[[@radarhere](https://github.com/radarhere)] - Only clear error if it is BufferError [#9727](python-pillow/Pillow#9727) \[[@radarhere](https://github.com/radarhere)] - Apply XOR mask to 1 and L mode CUR images [#9641](python-pillow/Pillow#9641) \[[@radarhere](https://github.com/radarhere)] - Do not raise error from unknown channel ID when parsing PSD layers [#9644](python-pillow/Pillow#9644) \[[@radarhere](https://github.com/radarhere)] - Raise ValueError if P;2L or P;4L data is truncated in frombytes() [#9725](python-pillow/Pillow#9725) \[[@radarhere](https://github.com/radarhere)] - Embed SBOM into wheels [#9679](python-pillow/Pillow#9679) \[[@hugovk](https://github.com/hugovk)] - Do not set eval() globals in ImageMath.unsafe\_eval() [#9576](python-pillow/Pillow#9576) \[[@radarhere](https://github.com/radarhere)] - Add Tcl/Tk license to wheels [#9663](python-pillow/Pillow#9663) \[[@radarhere](https://github.com/radarhere)] - Ensure map stride is at least one full row of pixels [#9719](python-pillow/Pillow#9719) \[[@radarhere](https://github.com/radarhere)] - Raise OverflowError if text width exceeds INT\_MAX [#9717](python-pillow/Pillow#9717) \[[@radarhere](https://github.com/radarhere)] - Raise error if image modes do not match ImageCms transform modes [#9715](python-pillow/Pillow#9715) \[[@radarhere](https://github.com/radarhere)] - Use int64\_t for text height [#9716](python-pillow/Pillow#9716) \[[@radarhere](https://github.com/radarhere)] - Return if error occurs in Py\_mod\_exec slot [#9712](python-pillow/Pillow#9712) \[[@radarhere](https://github.com/radarhere)] - Add decompression bomb checks to FontFile classes [#9711](python-pillow/Pillow#9711) \[[@radarhere](https://github.com/radarhere)] - If C error is raised, return NULL [#9706](python-pillow/Pillow#9706) \[[@radarhere](https://github.com/radarhere)] - Prevent saving 1 mode images as TGA with run-length encoding [#9709](python-pillow/Pillow#9709) \[[@radarhere](https://github.com/radarhere)] - Raise ValueError if EPS BeginBinary bytecount is negative [#9708](python-pillow/Pillow#9708) \[[@radarhere](https://github.com/radarhere)] - Do not DECREF tuple until tuple items are no longer used [#9707](python-pillow/Pillow#9707) \[[@radarhere](https://github.com/radarhere)] - Do not update NumPy automatically [#9713](python-pillow/Pillow#9713) \[[@radarhere](https://github.com/radarhere)] - Simplified code [#9642](python-pillow/Pillow#9642) \[[@radarhere](https://github.com/radarhere)] - If realloc fails, do not reduce block size [#9702](python-pillow/Pillow#9702) \[[@radarhere](https://github.com/radarhere)] - DECREF PyDict\_GetItemRef result [#9701](python-pillow/Pillow#9701) \[[@radarhere](https://github.com/radarhere)] - Use int64\_t to calculate paste box dimensions [#9703](python-pillow/Pillow#9703) \[[@radarhere](https://github.com/radarhere)] - Calculate JPEG2000 total\_component\_width for each tile in isolation [#9704](python-pillow/Pillow#9704) \[[@radarhere](https://github.com/radarhere)] - Raise ValueError if value is not bytes for TIFF\_BYTE or TIFF\_ASCII tag [#9699](python-pillow/Pillow#9699) \[[@radarhere](https://github.com/radarhere)] - Release Py\_Buffer on error [#9698](python-pillow/Pillow#9698) \[[@radarhere](https://github.com/radarhere)] - Use os.startfile() in WindowsViewer show\_file() [#9692](python-pillow/Pillow#9692) \[[@radarhere](https://github.com/radarhere)] - Validate large filter sizes when initializing RankFilter [#9695](python-pillow/Pillow#9695) \[[@radarhere](https://github.com/radarhere)] - Add decompression bomb check to GdImageFile [#9693](python-pillow/Pillow#9693) \[[@radarhere](https://github.com/radarhere)] - Free image bands when an error occurs while splitting an image [#9694](python-pillow/Pillow#9694) \[[@radarhere](https://github.com/radarhere)] - Check PyList\_Append return value [#9690](python-pillow/Pillow#9690) \[[@radarhere](https://github.com/radarhere)] - Check WebPMuxNew return value [#9689](python-pillow/Pillow#9689) \[[@radarhere](https://github.com/radarhere)] - Check PyCapsule\_New return value [#9691](python-pillow/Pillow#9691) \[[@radarhere](https://github.com/radarhere)] - Do not return negative width for text length [#9623](python-pillow/Pillow#9623) \[[@radarhere](https://github.com/radarhere)] - Add args argument to METH\_NOARGS methods [#9687](python-pillow/Pillow#9687) \[[@radarhere](https://github.com/radarhere)] - Check ImagingNewDirty return value [#9688](python-pillow/Pillow#9688) \[[@radarhere](https://github.com/radarhere)] - Use int64\_t for text width [#9686](python-pillow/Pillow#9686) \[[@radarhere](https://github.com/radarhere)] - Move PyDateTime\_IMPORT inside Py\_mod\_exec slot [#9580](python-pillow/Pillow#9580) \[[@radarhere](https://github.com/radarhere)] - Validate size and rank when initializing RankFilter [#9661](python-pillow/Pillow#9661) \[[@radarhere](https://github.com/radarhere)] - Raise ValueError if insufficient data is read from DDS RGB file [#9405](python-pillow/Pillow#9405) \[[@radarhere](https://github.com/radarhere)] - Correct `IFDRational.__float__()` return value [#9676](python-pillow/Pillow#9676) \[[@nyxst4ck](https://github.com/nyxst4ck)] - Correct length when accessing ImagePath.Path subscript [#9685](python-pillow/Pillow#9685) \[[@radarhere](https://github.com/radarhere)] - Release reference on non-flattened sequence error [#9684](python-pillow/Pillow#9684) \[[@radarhere](https://github.com/radarhere)] - Do not release Py\_buffer until buf is no longer in use [#9683](python-pillow/Pillow#9683) \[[@radarhere](https://github.com/radarhere)] - Do not resize macOS retina screenshots by default [#9266](python-pillow/Pillow#9266) \[[@radarhere](https://github.com/radarhere)] - Add abstract BaseImageFont class [#9595](python-pillow/Pillow#9595) \[[@radarhere](https://github.com/radarhere)] - Cast before multiplying [#9678](python-pillow/Pillow#9678) \[[@radarhere](https://github.com/radarhere)] - Limit radius to half width or height of rounded rectangle [#9561](python-pillow/Pillow#9561) \[[@radarhere](https://github.com/radarhere)] - linesize is always xsize multiplied by pixelsize [#9647](python-pillow/Pillow#9647) \[[@radarhere](https://github.com/radarhere)] - Check annotate\_hash\_table return value [#9572](python-pillow/Pillow#9572) \[[@radarhere](https://github.com/radarhere)] - Catch KeyError when checking mode from PNG IHDR chunk [#9604](python-pillow/Pillow#9604) \[[@radarhere](https://github.com/radarhere)] - Only pass one argument to C expand [#9664](python-pillow/Pillow#9664) \[[@radarhere](https://github.com/radarhere)] - Raise error if declared JPEG2000 marker length is too small [#9666](python-pillow/Pillow#9666) \[[@radarhere](https://github.com/radarhere)] - In \_dump(), use Python PPM save, instead of C [#9566](python-pillow/Pillow#9566) \[[@radarhere](https://github.com/radarhere)] - Raise error consistently from inside ImagingNewArrow [#9571](python-pillow/Pillow#9571) \[[@radarhere](https://github.com/radarhere)] - Simplify `RankFilter.c` check [#9662](python-pillow/Pillow#9662) \[[@radarhere](https://github.com/radarhere)] - Support opening and saving L mode AVIF images with libavif >= 1.3.0 [#9471](python-pillow/Pillow#9471) \[[@radarhere](https://github.com/radarhere)] - \[pre-commit.ci] pre-commit autoupdate [#9648](python-pillow/Pillow#9648) \[@[pre-commit-ci\[bot\]](https://github.com/apps/pre-commit-ci)] - Apply libtiff patch to fix CVE-2026-4775 [#9646](python-pillow/Pillow#9646) \[[@radarhere](https://github.com/radarhere)] - Remove duplicate code [#9640](python-pillow/Pillow#9640) \[[@radarhere](https://github.com/radarhere)] - Switch iOS back to macos-26-intel [#9631](python-pillow/Pillow#9631) \[[@radarhere](https://github.com/radarhere)] - Don't use list as default in PdfParser read\_prev\_trailer [#9629](python-pillow/Pillow#9629) \[[@danigm](https://github.com/danigm)] - Add support for Python 3.15 [#9624](python-pillow/Pillow#9624) \[[@radarhere](https://github.com/radarhere)] - Do not draw line or arc if width is zero [#9589](python-pillow/Pillow#9589) \[[@radarhere](https://github.com/radarhere)] - Use \_accept check in WebP \_open [#9605](python-pillow/Pillow#9605) \[[@radarhere](https://github.com/radarhere)] - Compare dist sizes vs latest PyPI release [#9621](python-pillow/Pillow#9621) \[[@hugovk](https://github.com/hugovk)] - Do not generate SBOM in scheduled run on fork [#9620](python-pillow/Pillow#9620) \[[@radarhere](https://github.com/radarhere)] - Use plugin method directly when saving PDFs [#9547](python-pillow/Pillow#9547) \[[@radarhere](https://github.com/radarhere)] - \[pre-commit.ci] pre-commit autoupdate [#9617](python-pillow/Pillow#9617) \[@[pre-commit-ci\[bot\]](https://github.com/apps/pre-commit-ci)] - Set Renovate prCreation to not-pending [#9616](python-pillow/Pillow#9616) \[[@radarhere](https://github.com/radarhere)] - Raise error if PNG transparency has incorrect type or length when saving [#9536](python-pillow/Pillow#9536) \[[@radarhere](https://github.com/radarhere)] - If PdfParser buffer is memoryview, release it when closing [#9596](python-pillow/Pillow#9596) \[[@radarhere](https://github.com/radarhere)] - Correct integer overflow in 16-bit resampling [#9480](python-pillow/Pillow#9480) \[[@hayatoikoma](https://github.com/hayatoikoma)] - SBOM: Use real versions from dependencies.json [#9593](python-pillow/Pillow#9593) \[[@hugovk](https://github.com/hugovk)] - Restrict SBOM upload to only Pillow JSON [#9598](python-pillow/Pillow#9598) \[[@radarhere](https://github.com/radarhere)] - Generate CycloneDX SBOM at release time via CI [#9550](python-pillow/Pillow#9550) \[[@aclark4life](https://github.com/aclark4life)] - Raise ValueError if ImageOps border has unsupported format [#9426](python-pillow/Pillow#9426) \[[@veeceey](https://github.com/veeceey)] - Unsafe pointer dereference from unchecked Python integer in Tk initialization [#9548](python-pillow/Pillow#9548) \[[@barttran2k](https://github.com/barttran2k)] - Reorder renovate.json [#9565](python-pillow/Pillow#9565) \[[@radarhere](https://github.com/radarhere)] - Add python-pillow GitHub Sponsors to FUNDING.yml [#9563](python-pillow/Pillow#9563) \[[@aclark4life](https://github.com/aclark4life)] - Correct environment URL [#9558](python-pillow/Pillow#9558) \[[@radarhere](https://github.com/radarhere)] - Remove or protect secrets in Actions [#9544](python-pillow/Pillow#9544) \[@[pre-commit-ci\[bot\]](https://github.com/apps/pre-commit-ci)] - Move Homebrew dependencies into Brewfile [#9546](python-pillow/Pillow#9546) \[[@hugovk](https://github.com/hugovk)] - Do not precompute horizontal coefficients if not horizontal resizing [#9543](python-pillow/Pillow#9543) \[[@radarhere](https://github.com/radarhere)] - Fix comparison warnings [#9541](python-pillow/Pillow#9541) \[[@radarhere](https://github.com/radarhere)] - Close PdfParser if error occurs during init [#9539](python-pillow/Pillow#9539) \[[@radarhere](https://github.com/radarhere)] - Drop experimental Python 3.13 free-threaded wheels [#9535](python-pillow/Pillow#9535) \[[@radarhere](https://github.com/radarhere)] - Update github-actions [#9533](python-pillow/Pillow#9533) \[@[renovate\[bot\]](https://github.com/apps/renovate)] </details> --- ### Configuration 📅 **Schedule**: (UTC) - Branch creation - At any time (no schedule defined) - Automerge - At any time (no schedule defined) 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Whenever PR is behind base branch, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Mend Renovate](https://github.com/renovatebot/renovate).  Reviewed-on: https://git.tainton.uk/repos/webexmemebot/pulls/596 Co-authored-by: renovate[bot] <renovate-bot@git.tainton.uk> Co-committed-by: renovate[bot] <renovate-bot@git.tainton.uk>

akx force-pushed the benchmarks branch 4 times, most recently from 6eb80ce to 096c161 Compare June 3, 2026 15:52

radarhere added Testing Performance labels Jun 3, 2026

radarhere reviewed Jun 4, 2026

View reviewed changes

Comment thread .ci/benchmark.sh Outdated

radarhere reviewed Jun 6, 2026

View reviewed changes

Comment thread Tests/benchmarks.py Outdated

radarhere reviewed Jun 6, 2026

View reviewed changes

Comment thread Tests/benchmarks.py Outdated

akx force-pushed the benchmarks branch from 542aae8 to 5577ff1 Compare June 9, 2026 08:30

akx force-pushed the benchmarks branch 2 times, most recently from 4ad8a01 to 502de76 Compare June 10, 2026 07:44

akx mentioned this pull request Jun 16, 2026

Speed up Image.getchannel(), Image.merge(), Image.putalpha() and Image.split() #9675

Merged

akx force-pushed the benchmarks branch from 502de76 to 09da4c7 Compare June 16, 2026 19:12

hugovk reviewed Jun 17, 2026

View reviewed changes

akx force-pushed the benchmarks branch 2 times, most recently from 1f4567e to f03d742 Compare June 17, 2026 16:16

This comment was marked as off-topic.

Sign in to view

hugovk mentioned this pull request Jun 28, 2026

Speed up Image.blend() #9649

Merged

akx and others added 3 commits June 29, 2026 11:26

Note all BuiltinFilters have a name attribute, to make Mypy happy

d42ed83

Port benchmarks from pillow-perf

129230c

Add more benchmarks from separate perf work branch

624c551

Co-authored-by: Hugo van Kemenade <1324225+hugovk@users.noreply.github.com>

akx force-pushed the benchmarks branch from f03d742 to 3e91b4b Compare June 29, 2026 08:26

hugovk reviewed Jun 29, 2026

View reviewed changes

Comment thread .github/workflows/test.yml Outdated

akx force-pushed the benchmarks branch from 3e91b4b to f902938 Compare June 29, 2026 08:51

akx force-pushed the benchmarks branch from f902938 to ad349d9 Compare June 29, 2026 09:32

CI: run codspeed (as a separate workflow)

a5d3c4c

akx force-pushed the benchmarks branch from ad349d9 to a5d3c4c Compare June 29, 2026 10:07

hugovk approved these changes Jun 29, 2026

View reviewed changes

radarhere reviewed Jun 29, 2026

View reviewed changes

Apply suggestions from code review

c286b6b

Co-authored-by: Hugo van Kemenade <1324225+hugovk@users.noreply.github.com>

hugovk merged commit 80ac5e3 into python-pillow:main Jun 29, 2026
52 of 54 checks passed

Uh oh!

Uh oh!

Conversation

akx commented Jun 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

radarhere commented Jun 6, 2026

Uh oh!

Uh oh!

Uh oh!

akx commented Jun 9, 2026

Uh oh!

hugovk left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

hugovk Jun 17, 2026

Choose a reason for hiding this comment

Uh oh!

akx commented Jun 17, 2026

Uh oh!

hugovk commented Jun 17, 2026

Uh oh!

This comment was marked as off-topic.

akx commented Jun 29, 2026

Uh oh!

Uh oh!

akx commented Jun 29, 2026

Uh oh!

codspeed-hq Bot commented Jun 29, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Congrats! CodSpeed is installed 🎉

Detected benchmarks

Uh oh!

akx commented Jun 29, 2026

Uh oh!

akx commented Jun 29, 2026

Uh oh!

hugovk left a comment

Choose a reason for hiding this comment

Uh oh!

hugovk Jun 29, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

radarhere Jun 29, 2026

Choose a reason for hiding this comment

Uh oh!

radarhere Jun 29, 2026

Choose a reason for hiding this comment

Uh oh!

radarhere Jun 29, 2026

Choose a reason for hiding this comment

Uh oh!

radarhere Jun 29, 2026

Choose a reason for hiding this comment

Uh oh!

akx commented Jun 29, 2026

Uh oh!

Uh oh!

hugovk commented Jul 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

akx commented Jun 3, 2026 •

edited

Loading

codspeed-hq Bot commented Jun 29, 2026 •

edited

Loading

hugovk commented Jul 1, 2026 •

edited

Loading