Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.Sign up
Added Gloo controller #1181
In our last pr, all MPI related operations have been decoupled from the control plane logic and abstracted as an MPI controller. This pr derives a new Gloo controller, which implemented all control plane logic including rendezvous independent of MPI environment. NCCL is supported for GPU data transferring.