Skip to content

PS5SD 1.2.0

Choose a tag to compare

@Darkatek7 Darkatek7 released this 14 Nov 08:59
· 8 commits to main since this release

PS5SD 1.2.0 makes models load about five times faster and makes the FLUX.3 Klein, Z-Image Turbo and Wan 2.1 presets skip the steps they can predict, with the same picture. All times are from the console; the measurements are in CONSOLE.md.

Faster loading

  • stable-diffusion.cpp read a model with 11 threads at once. On the PS5 that came to about 320 MB/s: reads from several threads at the same time are many times slower there than one stream.
  • Now one thread reads each file in large blocks, in the order the weights lie in it: 1.4 to 2.7 GB/s.
  • FLUX.3 Klein's weights load in 3.9 s instead of 19.2 s, Z-Image Turbo's in 4.8 s instead of 16.0 s.
  • The first FLUX.2 Klein 9B image after a start takes 55 s instead of 102 s.
  • A switch to sdxl-base takes 4.4 s instead of 9.1 s, to sdxl-full 9.8 s instead of 17.7 s.
  • The images are the same, pixel for pixel.

Fewer steps with Spectrum

  • The catalog's FLUX.3 Klein (Q4_K and Q6_K), Z-Image Turbo and both Wan 2.1 presets use --cache-mode spectrum. It computes the first four steps, then predicts the steps it can and skips them. The composition and the text in the picture stay.
Model 1.1.1 1.2.0
FLUX.3 Klein Q4, 1024x1024 114 s 73 s
FLUX.3 Klein Q4, the first image after a start 134 s 78 s
FLUX.3 Klein Q6, 896x896 93 s 59 s
Z-Image Turbo, 1024x1024 71 s 55 s
Wan 2.1 1.3B, 20 steps 140 s 86 s
  • Presets that an earlier version wrote and nobody changed get the new line at the first start. A preset you changed stays as it is.
  • Runs of 4 steps (CausVid, DMD2, FLUX.2 Klein 4B) are not changed.
  • To turn it off for one request, send "cache_mode": "disabled" to /sdcpp/v1/img_gen or vid_gen. To turn it off for a model, take the two lines out of its preset.
  • The other cache modes (cache-dit, dbcache, taylorseer) were faster on FLUX.3 Klein, but they change the picture, and cache-dit broke the text in it.

A shader cache

  • Mesa kept no shader cache on the console, so every start compiled every shader again. The cache is in /data/PS5SD/.cache/mesa now. It saves about a second a start.

Install

Install from the homebrew store, or unpack PPSA99576.zip into /data/homebrew/ on the console and let ShadowMountPlus scan. An update keeps your models, presets, gallery and settings.

Next: see ROADMAP.md. Two pictures for Edit (issue 13) comes in 1.3.0.