Popular repositories

1. Burst-Attention Burst-Attention Public

   Distributed IO-aware Attention algorithm

   Python 12

2. Seq1F1B Seq1F1B Public

   Forked from NVIDIA/Megatron-LM

   Sequence-level 1F1B schedule for LLMs.

   Python 9 2

3. Help-administrative-work Help-administrative-work Public

   在学校里总会有需要解决行政工作的时候，包括并不限于处理excel ，手写申请书，手写检讨，收作业。这里收集一些省时间的解决方案。

   Python 3

4. MayDomine.github.io MayDomine.github.io Public

   new guy

   PHP 1 1

5. BMTrain BMTrain Public

   Forked from OpenBMB/BMTrain

   Efficient Training (including pre-training and fine-tuning) for Big Models

   Python 1

6. flash-attention flash-attention Public

   Forked from Dao-AILab/flash-attention

   add attention mask for flash attention

   Python 1