A partial reimplementation of the Fully Sharded Data Parallel tool for AI model training
https://engineering.fb.com/2021/07/15/open-source/fsdp/
A partial reimplementation of the Fully Sharded Data Parallel tool for AI model training
https://engineering.fb.com/2021/07/15/open-source/fsdp/