| title | description | ms.service | ms.subservice | ms.topic | ms.date | ms.reviewer | ms.author | author |
|---|---|---|---|---|---|---|---|---|
High-performance computing on InfiniBand enabled HB-series and N-series VMs - Azure Virtual Machines |
Learn about the features and capabilities of InfiniBand enabled HB-series and N-series VMs optimized for HPC. |
azure-virtual-machines |
hpc |
overview |
07/25/2024 |
cynthn |
jushiman |
ju-shim |
Applies to: ✔️ Linux VMs ✔️ Windows VMs ✔️ Flexible scale sets ✔️ Uniform scale sets
Azure's InfiniBand enabled H-series and N-series VMs are designed to deliver leadership-class performance, Message Passing Interface (MPI) scalability, and cost efficiency for a variety of real-world HPC and AI workloads. These high-performance computing (HPC) optimized VMs are used to solve some of the most computationally intensive problems in science and engineering such as: fluid dynamics, earth modeling, weather simulations, etc.
These articles describe how to get started on the InfiniBand-enabled H-series and N-series VMs on Azure as well as optimal configuration of the HPC and AI workloads on the VMs for scalability.
The InfiniBand enabled HB-series and N-series VMs are designed to provide the best HPC performance, MPI scalability, and cost efficiency for HPC workloads. See HB-series and N-series VMs to learn more about the features and capabilities of the VMs.
RDMA capable HB-series and N-series VMs communicate over the low latency and high bandwidth InfiniBand network. The RDMA capability over such an interconnect is critical to boost the scalability and performance of distributed-node HPC and AI workloads. The InfiniBand enabled H-series and N-series VMs are connected in a non-blocking fat tree with a low-diameter design for optimized and consistent RDMA performance. See Enable InfiniBand to learn more about setting up InfiniBand on the InfiniBand enabled VMs.
The SR-IOV enabled HB-series and N-series support almost all MPI libraries and versions. Some of the most commonly used MPI libraries are: Intel MPI, OpenMPI, HPC-X, MVAPICH2, MPICH, Platform MPI. All remote direct memory access (RDMA) verbs are supported. See Set up MPI to learn more about installing various supported MPI libraries and their optimal configuration.
The first step is to select the HB-series and N-series VM type optimal for the workload based on the VM specifications and RDMA capability. Second, configure the VM by enabling InfiniBand. There are various methods to doing this including using optimized VM images with drivers baked-in; see Optimization for Linux and Enable InfiniBand for details. Third, for distributed node workloads, choosing and configuring MPI appropriately is critical. See Set up MPI for details. Fourth, for performance and scalability, optimally configure the workloads by following guidance specific to the VM family, such as for HBv3-series overview and HC-series overview.
- Learn about configuring and optimizing the InfiniBand enabled HB-series and N-series VMs.
- Review the HBv3-series overview and HC-series overview to learn about optimally configuring workloads for performance and scalability.
- Read about the latest announcements, HPC workload examples, and performance results at the Azure Compute Tech Community Blogs.
- Test your knowledge with a learning module on optimizing HPC applications on Azure.
- For a higher level architectural view of running HPC workloads, see High Performance Computing (HPC) on Azure.