From 89aa499abc5aa155fd0991087c6472453ab4c463 Mon Sep 17 00:00:00 2001 From: ver217 Date: Tue, 7 Mar 2023 10:55:03 +0800 Subject: [PATCH] [doc] add api reference --- docs/source/en/features/nvme_offload.md | 6 ++++++ docs/source/zh-Hans/features/nvme_offload.md | 6 ++++++ 2 files changed, 12 insertions(+) diff --git a/docs/source/en/features/nvme_offload.md b/docs/source/en/features/nvme_offload.md index dc5210135b48..03e2723ac0c5 100644 --- a/docs/source/en/features/nvme_offload.md +++ b/docs/source/en/features/nvme_offload.md @@ -247,3 +247,9 @@ Mem usage: 5298.344 MB ``` NVME offload saves about 294 MB memory. Note that enabling `pin_memory` of Gemini can accelerate training but increase memory usage. So this result also meets our expectation. If we disable `pin_memory`, we can aslo observe a memory usage drop about 900 MB. + +## API Reference + +{{ autodoc:colossalai.nn.optimizer.HybridAdam }} + +{{ autodoc:colossalai.nn.optimizer.CPUAdam }} diff --git a/docs/source/zh-Hans/features/nvme_offload.md b/docs/source/zh-Hans/features/nvme_offload.md index 436faca5733b..18989244feab 100644 --- a/docs/source/zh-Hans/features/nvme_offload.md +++ b/docs/source/zh-Hans/features/nvme_offload.md @@ -235,3 +235,9 @@ Mem usage: 5298.344 MB ``` NVME 卸载节省了大约 294 MB 内存。注意使用 Gemini 的 `pin_memory` 功能可以加速训练,但是会增加内存占用。所以这个结果也是符合我们预期的。如果我们关闭 `pin_memory`,我们仍然可以观察到大约 900 MB 的内存占用下降。 + +## API 参考 + +{{ autodoc:colossalai.nn.optimizer.HybridAdam }} + +{{ autodoc:colossalai.nn.optimizer.CPUAdam }}