Variety of prebuilt Flash Attention Wheel for Windows 11
https://github.com/dicksondickson/flash-attention-wheel/releases
Flash Attention 2.5.9 or 1.0.9 (for older GPUs)
Python 3.12.4 or Python 3.11 or 3.10
Windows 11
pyTorch Nightly
Cuda 12.5.0_555.85
Nvidia v555.99 Drivers