Skip to content

v1.0

Compare
Choose a tag to compare
@hyunwoongko hyunwoongko released this 18 Jul 00:09
· 61 commits to main since this release

GitHub release Apache 2.0 Docs Issues


  • Parallelformers, which is based on Megatron LM, is designed to make model parallelization easier.
  • You can parallelize various models in HuggingFace Transformers on multiple GPUs with a single line of code.
  • Currently, Parallelformers only supports inference. Training features are NOT included.