Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FP8 support planned (for both Ada and Hopper)? #2730

Closed
oscarbg opened this issue Mar 3, 2023 · 3 comments
Closed

FP8 support planned (for both Ada and Hopper)? #2730

oscarbg opened this issue Mar 3, 2023 · 3 comments
Assignees
@zerollzeng @nvpohanh
Labels
triaged Issue has been triaged by maintainers

Comments

@oscarbg
Copy link

oscarbg commented Mar 3, 2023

Hi,
even if can’t share details now,
hope to hear about some TensorRT fp8 support at GTC..
Motivation mainly to see if useful for stable difussion VoltaML implementation using TensorRT..
Understand tensor core fp8 support enabled in cuda 12.0 for hopper and 12.1 for Ada?
Thanks..
@oscarbg oscarbg mentioned this issue Mar 4, 2023
Closed
@zerollzeng
Copy link
Collaborator

@nvpohanh ^ ^

@zerollzeng zerollzeng added the triaged Issue has been triaged by maintainers label Mar 5, 2023
@nvpohanh
Copy link
Collaborator

nvpohanh commented Mar 8, 2023

This is already on the roadmap as one of the highest priority items, but it will take some time for us to complete it. Please stay tuned!

@ttyio
Copy link
Collaborator

ttyio commented Apr 4, 2023

Closing since no activity for more than 3 weeks, pls reopen if you still have question, thanks!

@ttyio ttyio closed this as completed Apr 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@zerollzeng zerollzeng

@nvpohanh nvpohanh

Labels
triaged Issue has been triaged by maintainers
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@ttyio @oscarbg @zerollzeng @nvpohanh