Skip to content
@ParCIS

ParCIS Lab, BUPT

Parallel Computing and Intelligent Systems Laboratory (ParCIS Lab), Beijing University of Posts and Telecommunications

Popular repositories Loading

  1. Magicube Magicube Public

    Magicube is a high-performance library for quantized sparse matrix operations (SpMM and SDDMM) of deep learning on Tensor Cores.

    C++ 86 17

  2. Chimera Chimera Public

    Chimera: bidirectional pipeline parallelism for efficiently training large-scale models.

    Python 61 8

  3. Ok-Topk Ok-Topk Public

    Ok-Topk is a scheme for distributed training with sparse gradients. Ok-Topk integrates a novel sparse allreduce algorithm (less than 6k communication volume which is asymptotically optimal) with th…

    Python 25 8

  4. FlashSparse FlashSparse Public

    FlashSparse significantly reduces the computation redundancy for unstructured sparsity (for SpMM and SDDMM) on Tensor Cores through a Swap-and-Transpose mapping strategy. FlashSparse is accepted by…

    Cuda 9 3

  5. DNN-cpp-proxies DNN-cpp-proxies Public

    C++/MPI proxies for distributed training of deep neural networks.

    C++ 1

Repositories

Showing 5 of 5 repositories
  • Chimera Public

    Chimera: bidirectional pipeline parallelism for efficiently training large-scale models.

    Python 61 GPL-3.0 8 3 1 Updated Mar 20, 2025
  • FlashSparse Public

    FlashSparse significantly reduces the computation redundancy for unstructured sparsity (for SpMM and SDDMM) on Tensor Cores through a Swap-and-Transpose mapping strategy. FlashSparse is accepted by PPoPP 2025.

    Cuda 9 3 2 0 Updated Feb 15, 2025
  • DNN-cpp-proxies Public

    C++/MPI proxies for distributed training of deep neural networks.

    C++ 1 GPL-3.0 0 0 0 Updated Jan 26, 2025
  • Ok-Topk Public

    Ok-Topk is a scheme for distributed training with sparse gradients. Ok-Topk integrates a novel sparse allreduce algorithm (less than 6k communication volume which is asymptotically optimal) with the decentralized parallel Stochastic Gradient Descent (SGD) optimizer, and its convergence is proved theoretically and empirically.

    Python 25 GPL-3.0 8 2 2 Updated Dec 10, 2022
  • Magicube Public

    Magicube is a high-performance library for quantized sparse matrix operations (SpMM and SDDMM) of deep learning on Tensor Cores.

    C++ 86 GPL-3.0 17 2 0 Updated Nov 23, 2022

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Most used topics

Loading…