New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

矩阵乘性能数据 #10

Open

yyfcc17 opened this issue May 29, 2024 · 2 comments

yyfcc17 commented May 29, 2024

你好，请问有W4A16与FP16矩阵乘的具体性能对比数据吗？

Collaborator

gavinchen430 commented May 31, 2024

在A30上，m=1,n=16384,k=4096 FP16带宽大概750GB/s， W4A16大概是600GB/s。

Author

yyfcc17 commented Jun 3, 2024

谢谢回复，请问具体的FP16矩阵乘和W4A16，W2A16矩阵乘，总体时间上加速如何呢？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment