Patiently waiting for triton 3.2.0 for Windows now that torch 2.6.0 is released

[BBC-Esq]

Here's what torch is being built/compatible with pursuant to:

pytorch/.github/scripts/generate_binary_build_matrix.py (within the torch repository)

Here is a brief selection of the pip-installable libraries that torch 2.6.0 has been tested/compatible with:

+-------------------+------------+--------------+----------+----------+----------+---------+
| Torch Version     | cuda-nvrtc | cuda-runtime | cublas   | cufft     | cudnn    | triton |
+-------------------+------------+--------------+----------+-----------+----------+--------+
| 2.6.0 (CUDA 12.6) | 12.6.77    | 12.6.77      | 12.6.4.1 | 11.3.0.4  | 9.5.1.17 | 3.2.0  |
| 2.6.0 (CUDA 12.4) | 12.4.127   | 12.4.127     | 12.4.5.8 | 11.2.1.3  | 9.1.0.70 | 3.2.0  |
| 2.5.1 (CUDA 12.4) | 12.4.127   | 12.4.127     | 12.4.5.8 | 11.2.1.3  | 9.1.0.70 | 3.1.0  |
| 2.5.1 (CUDA 12.1) | 12.1.105   | 12.1.105     | 12.1.3.1 | 11.0.2.54 | 9.1.0.70 | 3.1.0  |
+-------------------+------------+--------------+----------+-----------+----------+--------+

• 12.1.105 and 12.1.3.1 = CUDA release 12.1.1
• 12.4.127 and 12.4.5.8 = CUDA release 12.4.1
• 12.6.77 = CUDA release 12.6.2
• 12.6.4.1 = CUDA release 12.6.3
• See .json files here for more info: https://developer.download.nvidia.com/compute/cuda/redist/

Thus, apparently, PyTorch is building/testing with individual CUDA libraries originating from version 12.6.2 in their "cu126" wheels with on exception; their cublas version comes from CUDA 12.6.3.

And apparently torch 2.6.0 no longer builds wheels for CUDA 12.1

[DocShotgun]

https://github.com/facebookresearch/xformers/releases/tag/v0.0.29.post2

Looks like xformers updated to torch 2.6.0!

[BBC-Esq]

https://github.com/facebookresearch/xformers/releases/tag/v0.0.29.post2

Looks like xformers updated to torch 2.6.0!

Already aware. ;-) However, Pytorch hasn't posted the wheels for xformers for cu126 yet...it seems that the flow is...first, pytorch announces a major release...xformers releases a new version that's compatible...then pytorch builds the Windows wheels. lol. See here for the cu124 wheels...but the 126 ones aren't out yet:

https://download.pytorch.org/whl/cu124/xformers/

[woct0rdho]

Ok I've made the new release