Torch-TensorRT v2.12.1

Torch-TensorRT 2.12.1 Linux x86-64 and Windows targets

PyTorch 2.12, CUDA 13.0, TensorRT 10.16, Python 3.10~3.13

Torch-TensorRT Wheels are available:

x86-64 Linux and Windows:
CUDA 13.0 + Python 3.10-3.13 is Available via PyPI

• https://pypi.org/project/torch-tensorrt/

aarch64 SBSA Linux and Jetson Thor
CUDA 13.0 + Python 3.10–3.13 + Torch 2.12 + TensorRT 10.16

• Available via PyPI: https://pypi.org/project/torch-tensorrt/
• Available via PyTorch index: https://download.pytorch.org/whl/torch-tensorrt

Jetson Orin

• no torch_tensorrt 2.9/2.10/2.11/2.12 release for Jetson Orin
• please continue using torch_tensorrt 2.8 release

Torch-TensorRT-RTX 2.12.1 Linux x86-64 and Windows targets

PyTorch 2.12, CUDA 13.0, TensorRT-RTX 1.4, Python 3.10~3.13

Torch-TensorRT-RTX Wheels are available:

x86-64 Linux and Windows:
CUDA 13.0 + Python 3.10-3.13 is Available via PyPI

• https://pypi.org/project/torch-tensorrt-rtx/

CUDA 13.0 + Python 3.10-3.13 is also Available via Pytorch Index

• https://download.pytorch.org/whl/torch-tensorrt-rtx

What's Changed

• release 2.12 MD TRT fix by @apbose in #4291
• fix: cap tensorrt_rtx requirement below 1.5.0 on release/2.12 by @tp5uiuc in #4298
• fix(lowering): use factored sqrt form for complex acosh rewrite by @tp5uiuc in #4300
• setup_nccl_for_torch_tensorrt change by @apbose in #4303

Full Changelog: v2.12.0...v2.12.1