Skip to content

[microsoft/Megatron-DeepSpeed sync] Commits including 2021-09-18 #109

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
stas00 merged 1 commit into from
Sep 20, 2021
Merged

[microsoft/Megatron-DeepSpeed sync] Commits including 2021-09-18 #109

stas00 merged 1 commit into from
Sep 20, 2021

Conversation

@stas00
Copy link
Contributor

@stas00 stas00 commented Sep 20, 2021

This PR catches on 1 commit:

git remote add other https://github.com/microsoft/Megatron-DeepSpeed
git fetch other
git cherry-pick 1a74a0513441cf4
git push

New checkpoint is deepspeedai/Megatron-DeepSpeed@1a74a0513441cf4

@tjruwase @stas00
Checkpoint conversion tools (#14)
4b259b2 
* Checkpoint conversion tools

* Fix formatting

* 1) Provide args in converted checkpoint
2) Reshape TP and PP degrees

* Fix typo

* Fix link

* Tweak tag

* Fix converted TP and PP sizes

* For release mode

* Update README

* Nested embedding dicts
Iteration folder
latest checkpoint version file
@stas00 stas00 merged commit bc9c951 into main Sep 20, 2021
@stas00 stas00 deleted the sync5 branch September 20, 2021 18:57
ofirpress pushed a commit to ofirpress/Megatron-DeepSpeed that referenced this pull request Sep 23, 2021
@stas00 @tjruwase
Checkpoint conversion tools (bigscience-workshop#14) (bigscience-work…
8599444 
…shop#109)

* Checkpoint conversion tools

* Fix formatting

* 1) Provide args in converted checkpoint
2) Reshape TP and PP degrees

* Fix typo

* Fix link

* Tweak tag

* Fix converted TP and PP sizes

* For release mode

* Update README

* Nested embedding dicts
Iteration folder
latest checkpoint version file

Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
SaulLu added a commit to SaulLu/Megatron-DeepSpeed that referenced this pull request Sep 24, 2021
@SaulLu
Revert "Checkpoint conversion tools (bigscience-workshop#14) (bigscie…
2a02263 
…nce-workshop#109)"

This reverts commit 8599444.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@stas00 @tjruwase