Skip to content

Commit

Permalink
Update on "Get rid of dim_groups attribute from DeviceMesh"
Browse files Browse the repository at this point in the history
This PR get rids of the dim_groups attribute from DeviceMesh, the main
motivation behind this is that we should let c10d store the process
groups during its creation instead of DeviceMesh, DeviceMesh should just
handle ranks correctly.

This could enable DTensor becomes picklable! (torch.save/load could be
possible), which I will give it a try in the next PR

[ghstack-poisoned]
  • Loading branch information
wanchaol committed Jun 8, 2023
2 parents c79f753 + 8db103d commit 5de352e
Showing 0 changed files with 0 additions and 0 deletions.

0 comments on commit 5de352e

Please sign in to comment.