Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Try bf16 on AMD hardware #49

Closed
dirkgr opened this issue Mar 15, 2023 · 2 comments
Closed

Try bf16 on AMD hardware #49

dirkgr opened this issue Mar 15, 2023 · 2 comments
Assignees
@dirkgr
Labels
difficulty/easy Easy issue to tackle, may take a couple hours project/model Related to modeling decisions and implementations severity/must Things that definitely need to be implemented/fixed, but aren't urgent status/blocked Progress can't be made because we're waiting on something outside of our control

Comments

@dirkgr
Copy link
Member

dirkgr commented Mar 15, 2023

Turns out we never tried it. If this fails, we need to talk to AMD ASAP. We cannot get to 70B without this.
@dirkgr dirkgr added project/model Related to modeling decisions and implementations severity/must Things that definitely need to be implemented/fixed, but aren't urgent difficulty/easy Easy issue to tackle, may take a couple hours labels Mar 15, 2023
@dirkgr dirkgr self-assigned this Mar 15, 2023
@dirkgr dirkgr added the status/blocked Progress can't be made because we're waiting on something outside of our control label Mar 16, 2023
@dirkgr
Copy link
Member Author

dirkgr commented Mar 16, 2023

Blocked on LUMI being down.

@epwalsh
Copy link
Member

epwalsh commented Apr 17, 2023

This has been resolved, bf16 works fine on AMD GPUs.

@epwalsh epwalsh closed this as completed Apr 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@dirkgr dirkgr

Labels
difficulty/easy Easy issue to tackle, may take a couple hours project/model Related to modeling decisions and implementations severity/must Things that definitely need to be implemented/fixed, but aren't urgent status/blocked Progress can't be made because we're waiting on something outside of our control
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@dirkgr @epwalsh