Skip to content

hkproj/pytorch-transformer-distributed

Error
Looks like something went wrong!

About

Distributed training (multi-node) of a Transformer model

www.youtube.com/watch?v=toUSzwR0EV8

Topics

machine-learning tutorial deep-learning pytorch data-parallelism model-parallelism distributed-training gradient-accumulation distributed-data-parallel collective-communication

Resources

Readme
Activity

Stars

72 stars

Watchers

2 watching

Forks

31 forks
Report repository

Releases

No releases published

Packages

No packages published

Contributors 2

Languages