| title | description | author | ms.author | ms.reviewer | ms.service | ms.custom | ms.topic | ms.date | |
|---|---|---|---|---|---|---|---|---|---|
ND MI300X v5-series |
Specifications for the ND MI300X v5-series VMs |
charest |
marccharest |
mattmcinnes |
virtual-machines |
|
conceptual |
05/21/2024 |
Applies to: ✔️ Linux VMs ✔️ Flexible scale sets ✔️ Uniform scale sets
[!INCLUDE Size series summary]
[!INCLUDE series-specs]
Premium Storage: Supported
Premium Storage caching: Supported
Ultra disk: Supported Learn more about availability, usage, and performance
Live Migration: Not Supported
Memory Preserving Updates: Not Supported
VM Generation Support: Generation 2
Accelerated Networking: Supported
Ephemeral OS Disks: Supported
Infiniband: Supported, GPUDirect RDMA, 8x400 Gigabit NDR
Nested Virtualization: Not Supported
Important
To get started with ND MI300X v5 VMs, refer to HPC Workload Configuration and Optimization for steps including driver and network configuration. Due to increased GPU memory I/O footprint, the ND MI300X v5 requires the use of Generation 2 VMs and marketplace images.
| Size | vCPU | Memory: GiB | Temp storage (SSD) GiB | GPU | GPU Memory GiB | Max data disks | Max uncached disk throughput: IOPS/MBps | Max network bandwidth | Max NICs |
|---|---|---|---|---|---|---|---|---|---|
| Standard_ND96isr_MI300X_v5 | 96 | 1850 | 1000 | 8 MI300X | 192 | 32 | 40800/612 | 80,000 Mbps | 8 |
[!INCLUDE virtual-machines-common-sizes-table-defs]
[!INCLUDE sizes-footer]