Skip to content

Use new zero.Init() API#10

Merged
tjruwase merged 1 commit intomainfrom
olruwase/zero_init_mpu_v2
Aug 9, 2021
Merged

Use new zero.Init() API#10
tjruwase merged 1 commit intomainfrom
olruwase/zero_init_mpu_v2

Conversation

@tjruwase
Copy link

@tjruwase tjruwase commented Aug 9, 2021

Pass mpu and config_dict_or_path. Pair with this.

@tjruwase tjruwase merged commit 3123a29 into main Aug 9, 2021
saforem2 referenced this pull request in saforem2/Megatron-DeepSpeed Oct 11, 2024
Merge `alcf-tests` into `main`
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant