Repository navigation
We are excited to announce a new open-source release of our GIM SR-IOV Driver. Along with regular bug fixes and improvements, this release is aligned with ROCm 10.2.
New in this release:
- MI350P support - adds SR-IOV virtualization on AMD Instinct MI350P, with Ubuntu 24.04 as host and guest OS
Hardware / Features Supported for this Release
| AMD GPU | Host OS | Guest OS | VF per GPU - Compute Mode - Memory Mode | Infinity Fabric (XGMI) Configuration | ROCm / Graphics Version |
|---|---|---|---|---|---|
| AMD Instinct MI355X / AMD Instinct MI350X | Ubuntu 26.04 Kernel 7.0 | Ubuntu 26.04 | 1 - SPX - NPS1 | Between 8 GPUs | ROCm 10.2 |
| Ubuntu 24.04 Kernel 6.14 | Ubuntu 24.04 | 1 - SPX - NPS1 2* - DPX - NPS2 8* - CPX - NPS2 | |||
| RHEL 10.0 | 1 - SPX - NPS1 | ||||
| RHEL 9.6 | 1 - SPX - NPS1 | ||||
| AMD Instinct MI350P | Ubuntu 24.04 Kernel 6.14 | Ubuntu 24.04 | 1 - SPX - NPS1 | N/A | ROCm 10.2 |
| AMD Instinct MI325X | Ubuntu 26.04 Kernel 7.0 | Ubuntu 26.04 | 1 - SPX - NPS1 | Between 8 GPUs | ROCm 10.2 |
| Ubuntu 22.04 Kernel 6.8 | Ubuntu 22.04 | 1 - SPX - NPS1 | |||
| RHEL 10.2 Kernel 6.12.0-211 | RHEL 10.2 | 1 - SPX - NPS1 | |||
| RHEL 9.4 Kernel 5.14.0-427 | RHEL 9.4 | 1 - SPX - NPS1 | |||
| Ubuntu 24.04 | 1 - SPX - NPS1 | ||||
| AMD Instinct MI300X | Ubuntu 26.04 Kernel 7.0 | Ubuntu 26.04 | 1 - SPX - NPS1 | Between 8 GPUs | ROCm 10.2 |
| Ubuntu 24.04 Kernel 6.14 | Ubuntu 24.04 | 1 - SPX - NPS1 8* - CPX - NPS4 | |||
| Ubuntu 22.04 Kernel 6.8 | Ubuntu 22.04 | 1 - SPX - NPS1 | |||
| RHEL 10.2 Kernel 6.12.0-211 | RHEL 10.2 | 1 - SPX - NPS1 | |||
| RHEL 9.4 Kernel 5.14.0-427 | RHEL 9.4 | 1 - SPX - NPS1 8* - CPX - NPS4 | |||
| Ubuntu 24.04 | 1 - SPX - NPS1 8* - CPX - NPS4 | ||||
| AMD Instinct MI210 | Ubuntu 26.04 Kernel 7.0 | Ubuntu 26.04 | 1 | Between 2 / 4 GPUs | ROCm 10.2 |
| RHEL 9.4 Kernel 5.14.0-427 | RHEL 9.4 | 1 | |||
| Ubuntu 22.04 | 1 | ||||
| AMD Radeon PRO V710 | Ubuntu 26.04 Kernel 7.0 | ROCm and Graphics: Ubuntu 26.04 Ubuntu 24.04 RHEL 10.2 RHEL 9.6 |
1 to 12 | N/A | ROCm 10.2 amdgpu 6.4.2.2 |
| Ubuntu 24.04 Kernel 6.14 | ROCm and Graphics: Ubuntu 24.04 RHEL 10.2 RHEL 9.6 |
1 to 12 |
Partition Mode Support
| Number of VFs per GPU | Dynamic Compute Partitioning | NPS1 | NPS2 | NPS4 |
|---|---|---|---|---|
| 1 | SPX (Default) | MI300X, MI325X, MI350X, MI355X, MI350P | ||
| 1 | DPX | MI350X, MI355X | ||
| 1 | CPX | MI350X, MI355X | ||
| 2* | DPX | MI350X, MI355X | ||
| 8* | CPX | MI350X, MI355X | MI300X |
For the full list of supported partition modes and the relationship between partition mode and number of VFs per GPU, see the GPU Partitioning.
* Multi-VF Support requires a compatible firmware. Please refer to the ROCm Firmware Compatibility Table
Host AMD SMI Versions
- Library: 66.1.4
- Tool: 38.7.2
Please checkout out SMI doc for more details.
Getting Started
Please check out our User Guide for instructions on how to set up GIM and example configurations to run SR-IOV enabled VMs.
Known Issues
- On VMs with multiple VF assigned, detaching the VF (e.g. with virsh detach-device) while a workload is running will cause the guest kernel to refuse further GPU work. The VM needs to be restarted before GPU work can be issued again. This issue is limited to SPX/NPS1 configuration only.
- V710, MI3xx: there is a possibility VF FLRs will fail due to timeout. A server power cycle may be required to recover.