#

allreduce

Here are 8 public repositories matching this topic...

uccl-project / uccl

Ultra and Unified CCL

ai networking hpc amd gpu collective cuda p2p nvidia broadcom rdma allreduce llm kvcache

Updated Jul 2, 2025
C++

kanyun-inc / ytk-mp4j

Ytk-mp4j is a fast, user-friendly, cross-platform, multi-process, multi-thread collective message passing java library which includes gather, scatter, allgather, reduce-scatter, broadcast, reduce, allreduce communications for distributed machine learning.

machine-learning openmp mpi reduce broadcast messaging-library allreduce

Updated Jun 14, 2017
Java

YconquestY / nccl

Summary of call graphs and data structures of NVIDIA Collective Communication Library (NCCL)

computer-network allreduce nccl collective-communication

Updated Aug 20, 2024
D2

YconquestY / ncclAllReduce

multi-node mpi sharp multi-gpu allreduce nccl nvlink

Updated Oct 25, 2024
Cuda

wrathematics / spar

Sparse Allreduce

mpi sparse sparse-matrices allreduce

Updated Jul 7, 2020
C++

NiuHuangxiaozi / Deep-Learning-Parallelism

This repository outlines a comprehensive guide for training a distributed deep learning model.

pytorch ps ddp allreduce pipline deepspeed tensor-parallelism

Updated Jul 2, 2024
Python

YconquestY / cc

Summary of call graphs and data structures of collective communication plugin in NVIDIA TensorRT-LLM

allreduce collective-communication tensorrt-llm

Updated Nov 4, 2024
D2

udthegooner / Distributed-ML

Distributed training of a VGG-11 network on the CIFAR-10 dataset

pytorch ddp allreduce gloo vgg-11

Updated Apr 17, 2025
Python

Improve this page

Add a description, image, and links to the allreduce topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the allreduce topic, visit your repo's landing page and select "manage topics."