3. Developer Docs

Jump to bottom

Frank Lee edited this page Mar 7, 2023 · 2 revisions

📖 Overall Design

To be added.

⚡ Gemini

⚡ Tensor Parallelism

⚡ Pipeline Parallelism

⚡ Auto Parallelism

⚡ Auto Activation Checkpoint

Written by the Colossal-AI community with love 💙