Skip to content

[NVIDIA] Update B200 SGL FP8 and add FP4 TP4 - #42

Merged
kimbochen merged 4 commits into
mainfrom
kepotdar-update-sgl-b200
Sep 23, 2025
Merged

[NVIDIA] Update B200 SGL FP8 and add FP4 TP4#42
kimbochen merged 4 commits into
mainfrom
kepotdar-update-sgl-b200

Conversation

@kedarpotdar-nv

Copy link
Copy Markdown
Collaborator
  1. Use latest sgl container for FP8 B200
  2. Add TP4 concurrency in FP4 B200 sgl

TODO for later: update slurm script with latest flags

See runs:
https://github.com/InferenceMAX/InferenceMAX/actions/runs/17950828777/job/51049377968
https://github.com/InferenceMAX/InferenceMAX/actions/runs/17952378910/job/51054958566

@kimbochen

Copy link
Copy Markdown
Collaborator

thanks for the PR
lgtm

@kimbochen
kimbochen merged commit 6be2c69 into main Sep 23, 2025
@kimbochen
kimbochen deleted the kepotdar-update-sgl-b200 branch September 23, 2025 17:38
@cquil11 cquil11 added the NVIDIA label Apr 8, 2026
@cquil11 cquil11 changed the title Update B200 SGL FP8 and add FP4 TP4 [NVIDIA] Update B200 SGL FP8 and add FP4 TP4 Apr 8, 2026
cquil11 added a commit that referenced this pull request Aug 19, 2026
Pin the AIPerf submodule to PR #42 and enable --allow-empty-content only for the MiniMax-M3 B300 TensorRT-LLM AgentX recipe.

Signed-off-by: Cam Quilici <cjquilici@gmail.com>
cquil11 added a commit that referenced this pull request Aug 19, 2026
Pin the AIPerf submodule to PR #42 and enable --allow-empty-content only for the MiniMax-M3 B200 TensorRT-LLM AgentX recipe.

Signed-off-by: Cam Quilici <cjquilici@gmail.com>
cquil11 added a commit that referenced this pull request Aug 19, 2026
Pin the AIPerf submodule to PR #42 and enable --allow-empty-content only for the MiniMax-M3 B300 TensorRT-LLM AgentX recipe.

Signed-off-by: Cam Quilici <cjquilici@gmail.com>
cquil11 added a commit that referenced this pull request Aug 19, 2026
Pin the AIPerf submodule to PR #42 and enable --allow-empty-content only for the MiniMax-M3 B300 TensorRT-LLM AgentX recipe.

Signed-off-by: Cam Quilici <cjquilici@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants