Skip to content

Fix for pytorch 2.0 compatibility in deepspeed#1

Merged
cbcase merged 1 commit intoaugmentcode:augmentfrom
cbcase:pytorch2-testing
May 12, 2023
Merged

Fix for pytorch 2.0 compatibility in deepspeed#1
cbcase merged 1 commit intoaugmentcode:augmentfrom
cbcase:pytorch2-testing

Conversation

@cbcase
Copy link
Copy Markdown

@cbcase cbcase commented May 12, 2023

From my H100 testing, this was the minimum viable change to deepspeed to work with pytorch 2.

(See deepspeedai@d3de737)

Copy link
Copy Markdown

@marcmac marcmac left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks fine. Why do we try to import it in one file, and just assume it won't be there in the other two?

@cbcase
Copy link
Copy Markdown
Author

cbcase commented May 12, 2023

Looks fine. Why do we try to import it in one file, and just assume it won't be there in the other two?

The utils.py file imports inf in either the old or the new way, then the other two files pull it from utils.py (rather than from torch)

@cbcase cbcase merged commit ea3711b into augmentcode:augment May 12, 2023
@cbcase cbcase deleted the pytorch2-testing branch May 12, 2023 22:43
@marcmac
Copy link
Copy Markdown

marcmac commented May 14, 2023

I had no idea you could chain import like that. TIL.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants