Skip to content

ComfyUI-OrbitQuant 0.8.0

Latest
Latest

Choose a tag to compare

View all tags
@iamwavecut iamwavecut released this 16 Oct 18:31
v0.8.0
08ddd25
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

MOSS-Image recipe.

  • MOSS-Image SFT W4A8 (WaveCut/MOSS-Image-SFT-OrbitQuant-W4A8): the original MOSS-Image pipeline with the OrbitQuant transformer and text encoder, profiles default, model-offload and int8-attention. Zero dimensions give 1024 × 1024 and zero steps give 50 steps with guidance 3.
  • Example workflow "MOSS Image - image".
  • The MOSS-Image recipe requires orbitquant 0.14.0, Transformers 5.20 and Diffusers 0.41 in the model environment.

On one RTX 5090 a MOSS-Image request takes 32.4 s when it loads the model and 15.1 s on the next run, with a device peak of 12.8 GiB. model-offload lowers the peak to 9.9 GiB. The README lists the device and worker memory of each checked request.

Assets 2
Loading