Triton does not support Python 3.12 yet

[TheEgghead27]

Because triton does not support Python 3.12 yet, users of any projects that depend on it (such as https://github.com/openai/whisper) are met with pip dependency resolution errors, and are unable to work with these projects without having to manually install an older edition of Python.

It would be appreciated if Python 3.12 support were added, though it is not necessary for many use cases, and it is totally understandable if this is to be tabled for a later date, given that Python 3.12 comes with a plethora of breaking changes.

[jlebar]

Ugh, thank you for the bug report. I don't want to make life difficult for downstream consumers.

I'm not an expert in Python packaging, so I may be missing something. But I installed Python 3.12 and set up a virtualenv.
I was unable to install torch.

$ pip install torch
Looking in indexes: http://nginx.pypi.svc.cluster.local/simple/
ERROR: Could not find a version that satisfies the requirement torch (from versions: none)
ERROR: No matching distribution found for torch

torch is a prerequisite for running most of the Triton tests, so if I can't install it, I can't really test that Triton works with Python 3.12.

Looks like this is blocked on pytorch/pytorch#110436.

[jlebar]

users of any projects that depend on it (such as https://github.com/openai/whisper) are met with pip dependency resolution errors

Also, I may not be reading this correctly, but I don't think Whisper requires Python 3.12? https://github.com/openai/whisper/blob/e58f28804528831904c3b6f2c0e473f346223433/setup.py#L26

Your problem may be that you're running with Python 3.12, not that Whisper is requiring it. The Torch bug has instructions for running with an older Python.

[TheEgghead27]

Hi Justin, thank you for looking into this!

Definitely makes sense that 3.12 support for Triton (and in turn Whisper) will have to come after PyTorch; maybe one day we'll be able to bring the entire toolchain up to speed!

For now, I'll keep Python 3.11 in my workflows.

[EwoutH]

Some updates on Python 3.12 support in PyTorch:

• With PyTorch 2.2, wheels are being built and are available on PyPI.
  Pytorch for Python 3.12 not available pytorch/pytorch#110436
• torch.compile support is still being worked on.
  Torch compile does not work on python 3.12 pytorch/pytorch#120233