update version compatibility to allow torch 2.11.0.dev

[danielvegamyhre]

Stacked PRs:

• [mxfp8 moe training] add CUDA kernel for per group blocked layout with groups along M #3546
• ->update version compatibility to allow torch 2.11.0.dev #3545

---

update version compatibility to allow torch 2.11.0.dev

• update version compatibility to allow torch 2.11.0.dev
• Remove torch 2.9.0.dev nightlies, which are no longer active/indexed
• Also add logic so that if one .so fails to load, we still try to load the remaining ones, rather than skipping them. I added this because I found this bug where _C_cutlass_100a.abi3.so was failing to load and preventing mxfp8 .so from being loaded:
• Link cuda lib in mxfp8_cuda c++ extension for mxfp8 blocked layout kernel in next PR in stack

Loading /home/danvm/ao/torchao/_C_cutlass_100a.abi3.so Failed to import cpp extensions: operator torchao::_linear_8bit_act_1bit_weight does not exist

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/3545

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• B200 runners are down due to network issues

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[danielvegamyhre]

cc @vkuzo @andrewor14 for review

[liangel-02]

should we remove this line if the torch version has been bumped?

[danielvegamyhre]

hmm i'm not sure, there are still plenty of 2.10 nightlies active in the index people could be using: https://download.pytorch.org/whl/nightly/torch/

we also still have 2.9 nightlies listed in the compatibility table, which don't exist in the index anymore, so can probably be removed:

ao/torchao/__init__.py

Line 73 in 27c5eb9

(_parse_version("0.13.0"), _parse_version("2.9.0.dev")),

IMO we should:

• keep 2.10 nightlies while they are still active/indexed
• remove 2.9 nightlies which are no longer active/indexed

going to discuss in the team chat