Support Python 3.11

[EwoutH]

Currently Python 3.11 isn't fully supported in Pytorch yet, including testing in CI and publishing wheels to PyPI.

Python 3.11 is currently in Release Candidate state and will be released in about two weeks. Major packages like NumPy, Pandas, SciPy and Matplotlib have already uploaded their Python 3.11 wheels to PyPI.

Python 3.11 new features include:

• PEP 657 -- Include Fine-Grained Error Locations in Tracebacks
• PEP 654 -- Exception Groups and except*
• PEP 673 -- Self Type
• PEP 646-- Variadic Generics
• PEP 680-- tomllib: Support for Parsing TOML in the Standard Library
• PEP 675-- Arbitrary Literal String Type
• PEP 655-- Marking individual TypedDict items as required or potentially-missing
• bpo-46752-- Introduce task groups to asyncio
• The Faster Cpython Project is already yielding some exciting results: this version of CPython 3.11 is ~ 19% faster on the geometric mean of the PyPerformance benchmarks, compared to 3.10.0.

Pytorch is an import package in the deep learning stack, so support at release will help speed up Python 3.11 adoption.

It would be great to have full Python 3.11 support in Pytorch by the time Python 3.11.0 gets released, (expected Monday October 6th, 2022). This includes testing in CI and publishing wheels to PyPI.

This issue can be used as a tracking issue. This includes:

• Pytorch builds fully on Python 3.11
• All Pytorch tests pass on Python 3.11
• All CI is run and green on Python 3.11
• Wheels are uploaded to PyPI for at least one Pytorch release
  • Manylinux (x86_64)
  • Manylinux (aarch64)
  • Windows
  • macOS

cc @seemethere @malfet @pytorch/pytorch-dev-infra @albanD

[malfet]

Nightly builds of python-3.11 wheels is already published to https://download.pytorch.org/whl/nightly but CI can be tricky, in particular around JIT support (which probably needs a separate task)

[albanD]

I feel like the main blocker for enabling more support is that (at the time where this was added at least) conda didn't had 3.11 support.
This meant that all our usual test environment couldn't be upgraded easily.

[malfet]

@dagitses suggests that it's probably OK to disable JIT tests and have a followup issue for supporting JIT in 3.11.
Also please note that 3.11 is yet not available on Anaconda: https://anaconda.org/anaconda/python

[albanD]

cc @davidberard98 there will most likely be some non-trivial work needed for JIT to support this that should be planned for ahead of time.

[EwoutH]

Nightly builds of python-3.11 wheels is already published to https://download.pytorch.org/whl/nightly but CI can be tricky, in particular around JIT support (which probably needs a separate task)

Awesome! Do you know if the Python 3.11 wheels will be deployed with the v1.13 release?

[rijobro]

conda now has 3.11 support if that is still a blocker! conda install -c conda-forge python

[johnnynunez]

Yeah! Python 3.11 support please. It should be the default.
Python 3.11 is between 10-60% faster than Python 3.10. On average, we measured a 1.25x speedup on the standard benchmark suite. See Faster CPython for details.
https://docs.python.org/3.11/whatsnew/3.11.html
https://www.phoronix.com/news/Python-3.11-Released