Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Update on "Get rid of dim_groups attribute from DeviceMesh"
This PR get rids of the dim_groups attribute from DeviceMesh, the main motivation behind this is that we should let c10d store the process groups during its creation instead of DeviceMesh, DeviceMesh should just handle ranks correctly. This could enable DTensor becomes picklable! (torch.save/load could be possible), which I will give it a try in the next PR [ghstack-poisoned]
- Loading branch information