Neuron SDK Release - May 21, 2026

Release Date: May 21, 2026

Today we are releasing Neuron 2.30.0. NKI 0.4.0 introduces new hardware capabilities for Trn3 and the NKI Library adds 22 new kernels spanning context parallelism, MXFP8 training, and state-space models. Neuron Agentic Development, launched as a beta in April 2026, adds new model porting and numerical validation skills and is now included in all DLAMIs and DLCs by default. This release also introduces the Neuron DRA Driver for Kubernetes Dynamic Resource Allocation, enabling topology-aware scheduling of Trainium accelerators and EFA interfaces.

What’s in this release

• NKI 0.4.0 — New activate2 Scalar Engine instruction for Trn3, OCP FP8 input support for matmul, absolute-value reductions on the Vector Engine, bytes-aware tile-size constants, and improved CPU simulator accuracy. See Neuron Kernel Interface (NKI) [0.4.0] (Neuron 2.30.0 Release).

• NKI Library — 3 new core kernels (segmented attention, KV-parallel prefill, FP8 quantize) and 19 new experimental kernels covering context parallelism, MXFP8 training, state-space models, fused optimizers, and MoE dispatch. PyTorch reference implementations added for 29 kernels. See NKI Library (NKI-Lib) (Neuron 2.30.0 Release).

• Graph Compiler — Significant compile-time improvements through rewritten memory liveness analysis. Max computation tile size doubled to 1024. Coalesced reduce-scatter now optimized as a single unit for distributed training. See Neuron Compiler (Neuron 2.30.0 Release).

• Runtime & Driver — Zero-copy host-device transfers enabled by default, new async event APIs for framework integration, and Trn3 Gen2 UltraServer ring topology support in Collectives. See Neuron Runtime (Neuron 2.30.0 Release).

• Neuron Explorer — Region Highlighter for targeted profile analysis, PCIe transfer visualization in the System Trace Viewer, and Dependency Chain Viewer for system profiles. See Neuron Developer Tools & Neuron Explorer (Neuron 2.30.0 Release).

• Neuron Agentic Development — Launched as a beta in April 2026, Neuron Agentic Development adds two new skills in this release: neuron-framework-autoport ports HuggingFace models to NxD Inference end to end, and neuron-framework-equivalence validates numerical equivalence of ported models. Both included in all DLAMIs/DLCs by default. See Neuron Agentic Development (Neuron 2.30.0 Release).

• DLAMIs & Containers — All images now based on Ubuntu 24.04. Upgraded to JAX-NeuronX 0.10.0 (Python 3.13 in JAX SF DLAMI). See Neuron DLAMIs (Neuron 2.30.0 Release) and Neuron Containers [2.30.0] (Neuron 2.30.0 Release).