New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create a perf benchmark dashboard for gpt-fast #5225

Open

huydhn opened this issue May 21, 2024 · 1 comment

Assignees

Labels

Contributor

huydhn commented May 21, 2024

This is the next step after pytorch/pytorch#125891 to display TPS and throughput metrics on a new perf benchmark dashboard. Ref: https://hud.pytorch.org/benchmark/compilers

huydhn added the enhancement label

huydhn self-assigned this

Contributor Author

huydhn commented May 28, 2024 •

edited

The preview of the new dashboard is at https://torchci-git-fork-huydhn-add-gpt-fast-dashboard-fbopensource.vercel.app/benchmark/llms (from #5268). The next is to iterate on this with feedbacks from @yanboliang

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment