Highlights

NXP Neutron is production-ready.
TensorRT backend in beta.
Robotics: LeRobot policies such as SmolVLA and pi0 now run correctly on CUDA, MLX, OpenVINO, and XNNPACK.
Torch-free Python runtime: run .pte files from NumPy, buffers, or DLPack without PyTorch.
Faster GPU LLMs: batched serving, prefix caching, and DFlash speculative decoding on CUDA and MLX (fully integrated into Muse Glimmer).
Python 3.15 and PyTorch 2.15 support.

Runtime and Core

Added experimental ExecuTorch Native: a portable .ptn program lowered at load time by Vulkan or ggml engines.
Added the experimental executorch.runtime.cuda module for choosing the CUDA stream from Python.
Python runtime imports no longer pull in exir, Inductor, or Triton.
Added an experimental diffusion extension for Stable Diffusion 1.5 and SDXL.
Added memory-planned delegate scratch buffers and skip_h2d_for_constants.
Limited the default Linux thread pool to the CPUs the process may use.

Dropped Python 3.10; supported versions are now 3.11 through 3.15.
Added CUDA 13.4 wheels and dropped CUDA 12.6 and 13.0 wheels. Jetson Orin now needs a source build.
Added linkable C++ libraries, the CUDA runtime, and the OpenVINO delegate to the Windows wheels.
Added a pkg-config file to the Linux and macOS wheels.
Removed test-only packages from the executorch dependencies.

Arm

Added FP8 and BF16 to the VGF runtime and updated the Model Converter and ML Emulation Layer to 0.11.
Added dynamic-range W8A8 quantization for linear layers.
Added experimental delegate-owned streaming state for Ethos-U and updated the Ethos-U core driver to 26.08.
Removed dynamic allocation from the Ethos-U backend and hardened Vela binary parsing.
Added VGF quantization sensitivity and quality analysis tools.
Added SDPA decomposition and SAME-padding fusion for Cortex-M.
Added pow, isinf, isnan, TopK, softplus, roll, MaxPool1D, and negative padding.
Added a person detection example.
Removed deprecated tools, including examples/arm/aot_arm_compiler.py.

Qualcomm

Updated the QNN SDK to 2.51.
Added Flexible Context Binary export: one artifact for multiple Snapdragon SoCs.
Added on-device OpTrace and host-only Hextimate HTP profiling.
Added an HTP graph-splitting option for faster context finalization.
Added SC8480XP and Snapdragon 7+ Gen 3 support.
Added 8-bit KV-cache I/O for Hugging Face LLMs and W4 embedding and LM-head quantization for LLM QAT.
Added an example for supporting Custom Ops on LPAI backend
Added AdamW optimizer for on-device training.
Added STFT, empty_strided, and per-channel-group quantization.

CUDA and ROCm

Added autotuned INT4/5/6/8 quantized GEMM kernels on CUDA and ROCm, covering decode and small-batch prefill (M ≤ 64).
Made operator autotuning more accurate: candidates are now timed in CUDA graphs, so CPU overhead no longer affects the choice. Users can also set the example inputs used for benchmarking, and the tuner can choose between implementations (e.g. SDPA with or without split-K).
Added off-graph KV caches with a batching executor and prefix-cache reuse, on-device sampling, and DFlash drafting in CUDA graphs.
Sped up long-context attention with TMA causal prefill, in-kernel causal masks, and hardware-aware split-K decode.
Added lowering for complex-number RoPE, fused attention variants, and boolean mask indexing.

Apple (Core ML, Core AI, Metal, MLX)

Vulkan

NXP

Promoted the Neutron backend to production-ready.
Updated the eIQ Neutron SDK to 3.2.3.
Added recipe-based lowering for Neutron backend, Neutron recipe-based lowering supports both Post-training quantization and QAT workflows.
ExecuTorch test harness model suite enabled for Neutron backend.

XNNPACK

Other Backends

Cadence: added HiFi5 support.
Samsung: added Llama 3.2 1B, Gemma 3 1B, and YOLO26.
OpenVINO: CPU inference now defaults to float32; use the new inference_precision compile spec to change it.
WebGPU: added browser execution and an experimental Playground.
MediaTek: temporarily unsupported pending a Python 3.11+ NeuroPilot converter.

Added portable 3-D convolution, antialiased bicubic resize, bucketize, and _fft_r2c.
Added KleidiAI BF16 GEMM and SDPA dispatch.
Half and BFloat16 matmul and reductions now accumulate in float.
Floating-point floor_divide now matches ATen.

Fixed silently wrong XNNPACK outputs with shared BatchNorms and quantized ops left outside a delegate.
Fixed wrong outputs from Triton SDPA with wide attention heads and from OpenVINO partitions that return a copy of an input.
Fixed export of zero-stride constants and mixed-dtype cat.
Fixed Python logging deadlocks between threads.
Fixed Arm log-softmax underflow and round behavior.
Fixed QNN shared buffers on OE Linux.