Skip to content

[community] nvidia_a100_sxm4_40gbx1_suite_D_nvidia_sglang_c43a8309_99c43b97#42

Merged
JuhaoLiang1997 merged 1 commit into
mainfrom
submission/nvidia_a100_sxm4_40gbx1_suite_D_nvidia_sglang_c43a8309_99c43b97
May 15, 2026
Merged

[community] nvidia_a100_sxm4_40gbx1_suite_D_nvidia_sglang_c43a8309_99c43b97#42
JuhaoLiang1997 merged 1 commit into
mainfrom
submission/nvidia_a100_sxm4_40gbx1_suite_D_nvidia_sglang_c43a8309_99c43b97

Conversation

@github-actions
Copy link
Copy Markdown

Auto-generated from Issue #41

Submission summary

Field Value
Chip NVIDIA A100-SXM4-40GB
Chip count 1
Suite suite_D
Runner nvidia_sglang_c43a8309
Framework SGLang 0.5.6
Model meta-llama/Llama-3.1-8B-Instruct
Precision BF16
Offline throughput 60 tok/s
Online max QPS
Interactive TTFT p99 3186.0 ms
Accuracy valid True
Submitted by Gong-K
Date 2026-05-07 07:22:09
Run ID 99c43b97
Run name nvidia_a100_sxm4_40gbx1_suite_D_nvidia_sglang_c43a8309_99c43b97

Closes #41

@JuhaoLiang1997 JuhaoLiang1997 merged commit 5517b4a into main May 15, 2026
@JuhaoLiang1997 JuhaoLiang1997 deleted the submission/nvidia_a100_sxm4_40gbx1_suite_D_nvidia_sglang_c43a8309_99c43b97 branch May 15, 2026 02:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant