Pinned Loading

1. zo2 zo2 Public

   ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory

   Python 42 5

2. TheCoreTeam/core_scheduler TheCoreTeam/core_scheduler Public

   CoreScheduler: A High-Performance Scheduler for Large Model Training

   C++ 21 6

3. Tiny-DeepSpeed Tiny-DeepSpeed Public

   Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library

   Python 5 1

4. Flash-Attention-Implementation Flash-Attention-Implementation Public

   Implementation of Flash-Attention (both forward and backward) with PyTorch, CUDA, and Triton

   Python 1