[nv] h100: stp configs - #643
Merged
Merged
Conversation
Collaborator
|
thanks for the PR @ishandhanani ! can u add perfchange-log.yaml and sweep-enabled label to this PR? (sorry for this comment if this PR is still WIP) & the launcher script for h100 multinode |
kedarpotdar-nv
marked this pull request as draft
February 5, 2026 16:06
- Add framework-aware model path and container configuration - Map SGLang container to /mnt/nfs/lustre/containers/lmsysorg_sglang_v0.5.8.post1-cu130.sqsh - Add nginx container for SGLang at /mnt/nfs/lustre/containers/nginx_1.27.4.sqsh - Update srtslurm.yaml with dynamo-sglang and nginx-sqsh entries
ishandhanani
marked this pull request as ready for review
February 9, 2026 18:57
ishandhanani
added a commit
that referenced
this pull request
Feb 10, 2026
ishandhanani
added a commit
that referenced
this pull request
Feb 13, 2026
* init mtp * docs: add perf-changelog entry for H100 MTP SGLang configs Add changelog entry for dsr1-fp8-h100-dynamo-sglang configuration with MTP disaggregated multinode support. Co-authored-by: Cameron Quilici <cquil11@users.noreply.github.com> * Fix perf-changelog whitespace to satisfy process_changelog (additions-only) * typo * Add SGLang support to H100 runner - Add framework-aware model path and container configuration - Map SGLang container to /mnt/nfs/lustre/containers/lmsysorg_sglang_v0.5.8.post1-cu130.sqsh - Add nginx container for SGLang at /mnt/nfs/lustre/containers/nginx_1.27.4.sqsh - Update srtslurm.yaml with dynamo-sglang and nginx-sqsh entries * Add STP configs alongside MTP for H100 SGLang - Add STP entries (without spec-decoding) for all ISL/OSL combinations - Keep MTP entries (with spec-decoding: mtp) as before - Now both STP and MTP will run when testing dsr1-fp8-h100-dynamo-sglang * Restore B200 MTP SGLang config lost in merge The dsr1-fp8-b200-dynamo-sglang-mtp config was accidentally removed during merge conflict resolution. * Add perf-changelog entry for H100 STP SGLang (PR #643) * Comment out H100 SGLang STP configs for MTP-only CI testing * Increase H100 SLURM time limit from 4h to 6h --------- Co-authored-by: Cameron Quilici <cjquilici@gmail.com> Co-authored-by: claude[bot] <41898282+claude[bot]@users.noreply.github.com> Co-authored-by: Cameron Quilici <cquil11@users.noreply.github.com> Co-authored-by: Kedar Potdar <kepotdar@nvidia.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
5 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.