ParallelFrameworkComparison

Comparing the performance of different parallel training frameworks within training large-scale foundation models.

Name		Name	Last commit message	Last commit date
Latest commit History 26 Commits
DeepSpeed-Huge		DeepSpeed-Huge
DeepSpeed-Large		DeepSpeed-Large
FSDP-Huge		FSDP-Huge
FSDP-Large		FSDP-Large
Launchscripts DeepSpeed		Launchscripts DeepSpeed
Launchscripts FSDP		Launchscripts FSDP
LICENSE		LICENSE
README.md		README.md
fixdata.py		fixdata.py

Provide feedback