Skip to content

MPI4DL v0.5

Choose a tag to compare

View all tags
@Quentin-Anthony Quentin-Anthony released this 25 Sep 02:08
· 32 commits to main since this release
v0.5
e05797a
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

Initial release with distributed training support for:

  • Layer Parallelism (LP)
  • Pipeline Parallelism (PP)
  • Spatial Parallelism (SP)
  • Spatial and Layer Parallelism (SP+LP)
  • Spatial and Pipeline Parallelism (SP+PP)

Currently supports AmoebaNet and ResNet models. A more general model engine is WIP.

Assets 2
Loading