Staircase/Scanline artifacts with SDXL 1.0

[n00mkrad]

Describe the bug

SDXL creates colorful scanline-like artifacts, especially on areas with high-frequency detail.

SDXL - Diffusers 0.19.0 - 25 Steps of DPMSolverMultistepScheduler with Karras - 20% refine steps - CFG Scale 7

Left: SDXL 1.0 - Right: SDXL 0.9

Reproduction

Run SDXL 1.0 and compare results with SDXL 0.9

Logs

No response

System Info

Diffusers 0.19.0 - Windows 10 22H2 - RTX 4090 with drivers 536.40 - FP16 model

Who can help?

No response

[n00mkrad]

Also happens without refiner model.

[n00mkrad]

Workaround: Copy the 0.9 VAE to the 1.0 model.

The 1.0 VAE is broken.

LEFT: New VAE - RIGHT: Old VAE

[sayakpaul]

Thanks for investigating. We think it will be beneficial for potentially similar future issues :)

[catboxanon]

Did StabilityAI ever address this other than just silently dropping a "fixed" version (using the 0.9 VAE in the 1.0 checkpoints, as described above) in their respective repos? There's so much confusion and miscommunication around this that even the ControlNet author wasn't aware of this. (see discussion starting from here)

https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0/blob/main/sd_xl_base_1.0_0.9vae.safetensors
https://huggingface.co/stabilityai/stable-diffusion-xl-refiner-1.0/blob/main/sd_xl_refiner_1.0_0.9vae.safetensors

[fralumz]

The onnx vae should be reverted to 0.9 as well.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

[catboxanon]

Still interested to know whether or not StabilityAI officially addressed this, outside of silently releasing a "fixed" version. Seems awfully fishy to me.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

[catboxanon]

Bumping again.