Skip to content

Releases

PS5SD 1.3.1

Choose a tag to compare

@Darkatek7 Darkatek7 released this 17 Nov 21:11

PS5SD 1.3.1 makes images faster on every catalog model: the GPU now computes large matrix products in larger tiles. The images stay the same. All times are from the console; the measurements are in CONSOLE.md.

Larger matrix tiles

  • ggml-vulkan computes a matrix product in tiles. On AMD graphics without matrix cores, which the PS5 has, it left out its large tile (128x128), so every large product ran in 64x64 tiles.
  • PS5SD now uses the large tile for products that add up in f16. A product that adds up in f32 (some layers of Z-Image and SDXL ask for it) stays in the medium tile: there the large one took about four times as long.
  • The images of FLUX.3 Klein, FLUX.2 Klein 4B and 9B and Z-Image are the same, pixel for pixel. SDXL's differ in small details.
Catalog preset 1.3.0 1.3.1
FLUX.3 Klein Q4, 1024x1024 67 s 56 s
FLUX.2 Klein 9B, dpm2 at 8 steps 165 s 137 s
FLUX.2 Klein 9B, Euler at 4 steps 48 s 40 s
FLUX.2 Klein 4B 25 s 22 s
Z-Image Turbo 55 s 48 s
SDXL Base 28 s 27 s
Wan 2.1 1.3B, 9 frames at 832x480 84 s 80 s
  • FLUX.3 Klein Q6 at 896x896 takes about 45 s.
  • The memory a model needs is the same.
  • The catalog's descriptions give the new times.

Install

Install from the homebrew store, or unpack PPSA99576.zip into /data/homebrew/ on the console and let ShadowMountPlus scan. An update keeps your models, presets, gallery and settings.

Next: see ROADMAP.md. Two pictures for Edit (issue 13) comes in 1.4.0.

PS5SD 1.3.0

Choose a tag to compare

@Darkatek7 Darkatek7 released this 17 Nov 18:22

PS5SD 1.3.0 downloads the gallery as one ZIP (issue 20), makes a FLUX.3 Klein image in about 67 s instead of 74, and says how to run Krea 2 Turbo (issue 19). All times are from the console; the measurements are in CONSOLE.md.

The gallery as one ZIP

  • Download all in the gallery saves every image and video as one ZIP, ps5sd-gallery-<date>.zip. A PNG keeps its parameters inside; a video's parameters, and those of a PNG saved without them, come along as a text file next to it.
  • With two or more images selected, Download saves them as one ZIP too. One selected image still comes as the file itself.
  • The console makes the ZIP while it sends it, so it needs no room on the console and no time before the download starts. A gallery of 1.06 GB came in 24 s. The browser does not know the size until the download is done.
  • With the API key on, it works after the page's login, as the rest of the web UI does.
  • For programs: GET /ps5sd/v1/gallery/archive (everything, or ?names=a.png,b.webm) and POST with the names in the form field names. See API.md.

FLUX.3 Klein: Spectrum from the fourth step

  • The FLUX.3 Klein presets (Q4_K and Q6_K) start Spectrum one step earlier (--cache-option warmup=3). It skips 7 of 16 steps instead of 6.
FLUX.3 Klein Q4, 1024x1024 Image
no cache 114.5 s
1.2.x (Spectrum from the fifth step) 73.9 s
1.3.0 (from the fourth step) 67.1 s
  • The picture stays the same, faces, hands and the text in it too. From the third step on it would be 60 s, but hands and objects moved, so the presets stop at the fourth.
  • Presets that 1.2.x wrote and nobody changed get the new line at the first start. A preset you changed stays as it is.
  • A request can set it with "cache_option", for example "warmup=4" for the old behaviour.

Krea 2 Turbo

  • Krea 2 Turbo runs on the PS5: 1024x1024 at 8 steps in about 3 minutes (FLUX.3 Klein: about 1 minute).
  • It is not in the catalog. Its licence, the Krea 2 Community License, asks everyone who deploys the model for a content filter (section 4.2), and PS5SD has none.
  • MODELS.md gives the three files and a preset, for those who read the licence and want to use it.

Looked at and left

  • VAE tiles of 768 instead of 512 save 0.3 s an image; without tiles the VAE does not fit.
  • Flash attention is on already, for every attention of a run.
  • FLUX.2 Klein 9B's preset stays at 8 steps with dpm2 (165 s). 4 steps with Euler take 48 s; the catalog's description says so.

Install

Install from the homebrew store, or unpack PPSA99576.zip into /data/homebrew/ on the console and let ShadowMountPlus scan. An update keeps your models, presets, gallery and settings.

Next: see ROADMAP.md. Two pictures for Edit (issue 13) moves to 1.4.0.

PS5SD 1.2.1

Choose a tag to compare

@Darkatek7 Darkatek7 released this 14 Nov 09:04

PS5SD 1.2.1 lets a LoRA's strength go past 2, as issue 18 asked.

LoRA strengths from -100 to 100

  • The web UI kept a LoRA's strength between -2 and 2. Some LoRAs are made for much more: slider LoRAs, for example, go from -8 to 8.
  • The strength field on the Create tab, under Style, now takes -100 to 100, the same range as ComfyUI's LoRA loader.
  • sd-server never had a limit, so the API and presets (loras=path:strength) take any strength as before.
  • Most LoRAs are still made for about 0 to 1. The LoRA's page says what it is made for.

1.2.0's faster loading and Spectrum presets are in this release too. See PS5SD 1.2.0.

Install

Install from the homebrew store, or unpack PPSA99576.zip into /data/homebrew/ on the console and let ShadowMountPlus scan. An update keeps your models, presets, gallery and settings.

Next: see ROADMAP.md. Two pictures for Edit (issue 13) comes in 1.3.0.

PS5SD 1.2.0

Choose a tag to compare

@Darkatek7 Darkatek7 released this 14 Nov 08:59

PS5SD 1.2.0 makes models load about five times faster and makes the FLUX.3 Klein, Z-Image Turbo and Wan 2.1 presets skip the steps they can predict, with the same picture. All times are from the console; the measurements are in CONSOLE.md.

Faster loading

  • stable-diffusion.cpp read a model with 11 threads at once. On the PS5 that came to about 320 MB/s: reads from several threads at the same time are many times slower there than one stream.
  • Now one thread reads each file in large blocks, in the order the weights lie in it: 1.4 to 2.7 GB/s.
  • FLUX.3 Klein's weights load in 3.9 s instead of 19.2 s, Z-Image Turbo's in 4.8 s instead of 16.0 s.
  • The first FLUX.2 Klein 9B image after a start takes 55 s instead of 102 s.
  • A switch to sdxl-base takes 4.4 s instead of 9.1 s, to sdxl-full 9.8 s instead of 17.7 s.
  • The images are the same, pixel for pixel.

Fewer steps with Spectrum

  • The catalog's FLUX.3 Klein (Q4_K and Q6_K), Z-Image Turbo and both Wan 2.1 presets use --cache-mode spectrum. It computes the first four steps, then predicts the steps it can and skips them. The composition and the text in the picture stay.
Model 1.1.1 1.2.0
FLUX.3 Klein Q4, 1024x1024 114 s 73 s
FLUX.3 Klein Q4, the first image after a start 134 s 78 s
FLUX.3 Klein Q6, 896x896 93 s 59 s
Z-Image Turbo, 1024x1024 71 s 55 s
Wan 2.1 1.3B, 20 steps 140 s 86 s
  • Presets that an earlier version wrote and nobody changed get the new line at the first start. A preset you changed stays as it is.
  • Runs of 4 steps (CausVid, DMD2, FLUX.2 Klein 4B) are not changed.
  • To turn it off for one request, send "cache_mode": "disabled" to /sdcpp/v1/img_gen or vid_gen. To turn it off for a model, take the two lines out of its preset.
  • The other cache modes (cache-dit, dbcache, taylorseer) were faster on FLUX.3 Klein, but they change the picture, and cache-dit broke the text in it.

A shader cache

  • Mesa kept no shader cache on the console, so every start compiled every shader again. The cache is in /data/PS5SD/.cache/mesa now. It saves about a second a start.

Install

Install from the homebrew store, or unpack PPSA99576.zip into /data/homebrew/ on the console and let ShadowMountPlus scan. An update keeps your models, presets, gallery and settings.

Next: see ROADMAP.md. Two pictures for Edit (issue 13) comes in 1.3.0.

PS5SD 1.1.1

Choose a tag to compare

@Darkatek7 Darkatek7 released this 12 Nov 23:27

PS5SD 1.1.1 fixes two things people asked for: issue 16 (a preset with a LoRA whose name has spaces in it) and issue 15 (any width and height). It also brings back the home screen background, which 1.1.0 lost.

A preset keeps a LoRA of any name

  • Save as preset failed when a LoRA's file name had a space, [, ], @ or another sign in it. Presets keep their settings on one line, where a value is one word.
  • The web UI writes such a name percent-encoded now, as in a URL (my%20style%20%5Bv2%5D.safetensors), and reads it back. Presets saved before read as they did.
  • Write a preset by hand the same way. See MODELS.md.

Any width and height

  • The Width and Height fields take any whole number from 64 to 4096 when you type it in. Their arrows still step by 64.
  • Before, a size was rounded to a multiple of 8 and kept to 2048 at most.
  • stable-diffusion.cpp rounds a size up to the multiple the model works in, so the image can come out a few pixels larger than asked.
  • A preset's width and height take any size from 64 to 4096 too.
  • The fit hint still says when a size is larger than anything measured on the console.

The home screen background is back

  • 1.1.0 showed a plain dark gradient on the home screen instead of PS5SD's own picture. The build had made the background plain, and nothing checked it.
  • 1.1.1 has the picture again, and the build now stops when a background comes out plain.

Install

Install from the homebrew store, or unpack PPSA99576.zip into /data/homebrew/ on the console and let ShadowMountPlus scan. An update keeps your models, presets, gallery and settings.

Next: see ROADMAP.md. Image to text (issue 14) is on it now.

PS5SD 1.1.0

Choose a tag to compare

@Darkatek7 Darkatek7 released this 12 Nov 21:54

PS5SD 1.1.0 runs on the stable-diffusion.cpp of November: upstream 32d516c, 111 commits newer than 1.0's. Nothing changes for a client of the API, and the times and memory are those of 1.0. The details are in ROADMAP.md.

stable-diffusion.cpp of November

  • All of PS5SD's patches were moved onto it. One is gone, since upstream does that itself now: the LoRA list refreshes before a request.
  • Upstream's server cancels a running job itself now. PS5SD keeps what its API promises on top of it: 202 for a running job, /ps5sd/v1/jobs, and A1111's interrupt and skip.
  • A run that does not fit in one piece still runs in segments. Upstream moved the graph's execution into its new execution engine, and the patch went with it.
  • Job times stay in seconds, as in 1.0, although upstream counts milliseconds now.

Images carry sd.cpp's new generation info

  • A saved image's parameters are A1111's text with sd.cpp's JSON at the end, as upstream writes them now. The JSON's schema is sdcpp.generation/v1 (before, sdcpp.image.params/v1).
  • The gallery viewer reads both, so older images keep their info and Use all.
  • The text still has PS5SD's Preset: and Time:.

A fix for the console

  • Upstream checks each LoRA path with realpath() now, which does not work on the PS5. On the console the server would have found no LoRA. A new patch (0084) takes the path as it is there.

Tested on the console

  • Switches between presets, an image with a LoRA on FLUX.2 Klein 9B, a cancel, a repeat job, a video, the hires fix with a guide image, and the gallery's info for an old image and a new one.
  • A soak test of 25 minutes: 4 rounds, 28 jobs, no failure. The times are those of 1.0: Z-Image Turbo 88 s, SDXL 28 to 30 s, Klein 9B with a LoRA 136 s, a Wan 2.1 video 86 to 88 s. The CPU heap settled at 0.73 GiB, a little above 1.0's 0.66 GiB. The numbers are in CONSOLE.md.
  • An update from 1.0.0 and from 0.9.18 keeps presets, settings, gallery names and tags, and the API key (scripts/update-test.py).

Install

Install from the homebrew store, or unpack PPSA99576.zip into /data/homebrew/ on the console and let ShadowMountPlus scan. An update keeps your models, presets, gallery and settings.

Next: see ROADMAP.md. Two pictures for Edit (issue 13) are 1.2.0 now.

PS5SD 1.0.0

Choose a tag to compare

@Darkatek7 Darkatek7 released this 28 Oct 14:43

PS5SD 1.0.0 is the version that keeps its promises: every item of the 1.0 checklist in ROADMAP.md holds. From here on, a change that breaks a client of the API needs a new major version.

What 1.0 means

  • The API is fixed: one error shape with a code, progress as server-sent events, POST /sdapi/v1/options waits for the model, the model of an OpenAI request switches it, and an OpenAPI description at /ps5sd/v1/app/openapi.json (0.9.15 to 0.9.17).
  • No run fails without a reason: the web UI says before a run when it may not fit and what to lower; a run that fails anyway says why (0.9.18).
  • No known crash: the two ends 0.9.18's measurements found are fixed, and there is no open bug.

An update keeps everything

  • Tested on the console from every release since 0.5.0 (26 releases): install the old one, make models, LoRAs, presets, images, settings and an API key through its API, update to 1.0, and check that all of it is still there. All 26 passed. scripts/update-test.py does it again for any build.

A soak test

  • 38 minutes of mixed load on the console: 22 model switches between Z-Image Turbo, SDXL, FLUX.2 Klein 9B with a LoRA and Wan 2.1, 36 jobs with three queued at once, a cancel while a job runs, a video, and an event stream open all along. Every job and switch did what it should, each round took the same time, and the CPU heap stayed at 0.63 to 0.66 GiB after the first round. scripts/soak-test.py runs it again. The numbers are in CONSOLE.md.

A home screen background of its own

  • The placeholder background is gone: ribbons of blue, violet and pink light, made by PS5SD itself on the console with FLUX.2 Klein 4B. A home screen theme that shows its own picture for every app still wins.

The docs

  • New screenshots of the web UI in the README, on a PC and a phone.

Install

Install from the homebrew store, or unpack PPSA99576.zip into /data/homebrew/ on the console and let ShadowMountPlus scan. An update from any 0.x release keeps your models, presets, gallery and settings.

Next: see ROADMAP.md.

PS5SD 0.9.18

Choose a tag to compare

@Darkatek7 Darkatek7 released this 28 Oct 13:03

PS5SD 0.9.18 measures what was still open on the way to 1.0, and fixes the two ends of the title that those runs found.

A guide image with the hires fix no longer ends PS5SD

  • With a guide image (ControlNet) and the hires fix, PS5SD ended: the hires pass gave the ControlNet the guide at the first pass's size. The guide now has the size of the hires pass. SDXL with xinsir's Canny ControlNet makes 1024x1024 to 1536x1536 in about 6 minutes.
  • When the console's CPU memory ran out inside ggml's own code, that also ended PS5SD. Now the run fails with "Not enough memory on the console" and what to lower, after one more try, and PS5SD keeps running.

Measured on the console

  • SDXL with the hires fix: 1536x1536 in 103 s, 2048x2048 in 202 s, 2560x2560 in 7 minutes, 3072x3072 in 23 minutes. 4096x4096 runs out of memory.
  • Upscale 1024 to 4096: 62 s with RealESRGAN x4plus, 24 s with the anime model.
  • Inpainting: SDXL Base 53 s, SDXL Inpainting about 2 minutes, SD 1.5 Inpainting 12 s.
  • The catalog's ControlNet and inpainting entries now say their time.
  • CONSOLE.md has the tables.

The hint before a run

  • "May not fit" now also says what to lower.
  • A model family nobody measured says so above 1024x1024, instead of saying nothing.
  • A guide image has limits of its own (SDXL with a ControlNet up to 1536x1536).

The docs

  • README, MODELS.md, API.md and the Help tab were read against the title, and some 30 things that were no longer true or missing are fixed. Among them: the API key is on the Settings tab, a model switch no longer restarts the server, the error codes 405/422/501/503, and what server-args.txt does.
  • New: a section on the TV dashboard, "Edit by the prompt", and Help sections on the hires fix, the queue and the memory hint.
  • Links to a heading inside the docs now work in the Help tab.

Install

Install from the homebrew store, or unpack PPSA99576.zip into /data/homebrew/ on the console and let ShadowMountPlus scan.

Next: see ROADMAP.md.

PS5SD 0.9.17

Choose a tag to compare

@Darkatek7 Darkatek7 released this 28 Oct 11:00

PS5SD 0.9.17 finishes 1.0's "The API is fixed" with an OpenAPI description of every route, and keeps a Close from the home screen from ending in a crash report when the title hangs.

OpenAPI

  • GET /ps5sd/v1/app/openapi.json describes the whole API as OpenAPI 3.1: 63 paths and 70 operations, with their parameters, bodies, answers and errors, and the four ways to send the API key.
  • It answers without the API key, so Swagger UI, Postman or a client generator can read it before they know the key.
  • CI checks that the spec lists every route the server and the app register, and no other (scripts/check-openapi.py), so it stays in step with the code.

A safe Close while the title hangs

  • On a Close from the home screen the system suspends the title first, and it needs a GPU suspend point for that. If the title had passed none for 25 s, the Close ended in a crash report.
  • That could happen when the main loop got stuck inside a frame while the server was idle.
  • A thread now passes a suspend point every 100 ms. Measured on the console with a main loop stuck inside a frame: without the thread a Close took 7.8 s and ended in a crash report; with it, 85 to 91 ms and a clean end. CONSOLE.md has the table.

Also tested

  • POST /sdapi/v1/options with a model that does not load answers 500 load_failed with the reason, and the server goes back to the last model that worked.
  • The web UI follows a model switch, whether the page started it or a client did.

Install

Install from the homebrew store, or unpack PPSA99576.zip into /data/homebrew/ on the console and let ShadowMountPlus scan.

Next: see ROADMAP.md.

PS5SD 0.9.16

Choose a tag to compare

@Darkatek7 Darkatek7 released this 28 Oct 10:23

PS5SD 0.9.16 switches the model without stopping the server, so the web UI and the API stay up, and lets clients wait for a model as A1111 and OpenAI clients expect.

A model switch without stopping the server

  • A switch loads the next model into the running server. Before, the server stopped and started again, and nothing answered on the port while the model loaded.
  • The web UI, the gallery, the library, the job list and the event stream keep answering during a switch.
  • A request that needs the model waits until it has loaded, then runs on it. A job queued meanwhile stays queued and runs on the new model.
  • Measured on the console, five rounds of FLUX.2 Klein 9B with a LoRA and SDXL against 0.9.15: the same times and memory, a lower CPU heap (0.81 instead of 0.94 GiB at the peak), and no request without an answer (0 of 893, against 19 of 862). CONSOLE.md has the table.

Waiting for a model

  • POST /sdapi/v1/options with sd_model_checkpoint answers once the model has loaded, as A1111 does: 8.3 s for SDXL on the console. A model that does not load answers 500 load_failed with the reason; after 10 minutes, 504 timeout.
  • The model of /v1/images/generations and /v1/images/edits picks the model: a model of the library is switched to and waited for. Any other name, such as the dall-e-3 or gpt-image-1 that OpenAI clients send, runs on the loaded model.

The switch in the event stream

  • GET /ps5sd/v1/events sends a model event with active, loaded, switching, standby and load_error whenever they change.
  • The web UI follows it, and shows a switch that another page or a client started.

See API.md for the details.

Install

Install from the homebrew store, or unpack PPSA99576.zip into /data/homebrew/ on the console and let ShadowMountPlus scan.

Next: see ROADMAP.md.