SageAttention on NVIDIA RTX 50-series (Blackwell) - 30% Faster, Native Windows #11583
mobcat40
started this conversation in
Show and tell
Replies: 1 comment 3 replies
|
what about linux is this working on it, seeking sageattention 2.2 working on rtx 6k pro, plz lemme know, urgennnnnnnnnnnnnt |
3 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
SageAttention + PyTorch 2.11 Nightly on RTX 50-series (Blackwell) - 30% Faster, Native Windows
Got SageAttention 2.2.0 working on Blackwell GPUs with native Windows - no Docker or WSL needed. ~30% faster diffusion sampling.
Download
Prebuilt wheel: https://github.com/mobcat40/sageattention-blackwell
Requirements
Install (2 minutes)
Usage in ComfyUI
Don't use
--use-sage-attentionflag - it uses the Triton backend which causes black output with some models (Qwen, Wan).Instead:
sageattn_qk_int8_pv_fp16_cudaPerformance
~30-35% faster on RTX 5090 (tested with Qwen Image Edit: 14m30s → 9m30s for 40 steps)
Why this exists
pip install sageattentioninstalls 1.0.6 which causes black outputFull build instructions if you want to compile yourself: https://github.com/mobcat40/sageattention-blackwell/blob/main/BUILD_STORY.md
All reactions