Skip to content

Stabilize perf warmup#5913

Merged
Phlip79 merged 3 commits into
NVIDIA:mainfrom
Phlip79:philip/stabilize-perf-warmup
Jul 21, 2026
Merged

Stabilize perf warmup#5913
Phlip79 merged 3 commits into
NVIDIA:mainfrom
Phlip79:philip/stabilize-perf-warmup

Conversation

@Phlip79

@Phlip79 Phlip79 commented Jul 20, 2026

Copy link
Copy Markdown
Member
  • I, the PR author, have personally reviewed every line of this PR.

What does this PR do?

Stabilizes multi-worker inference performance measurements by warming every coordinator worker before timed batches, while preserving timed batch sizes and prompt sequences; adds focused unit coverage and refreshes the H100 gpt_583m_perf golden values from the validated post-fix run.

Testing

Before vs after

Phlip79 added 2 commits July 20, 2026 20:30
Signed-off-by: Philip Petrakian <ppetrakian@nvidia.com>
…lip/stabilize-perf-warmup

Signed-off-by: Philip Petrakian <ppetrakian@nvidia.com>
@copy-pr-bot

copy-pr-bot Bot commented Jul 20, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

Signed-off-by: Philip Petrakian <ppetrakian@nvidia.com>
@Phlip79

Phlip79 commented Jul 20, 2026

Copy link
Copy Markdown
Member Author

/ok to test 065fdec

@Phlip79
Phlip79 added this pull request to the merge queue Jul 21, 2026
@svcnvidia-nemo-ci

Copy link
Copy Markdown
Contributor

🔄 Merge queue validation started!

You can track the progress here: https://github.com/NVIDIA/Megatron-LM/actions/runs/29796217615

Merged via the queue into NVIDIA:main with commit 7012adb Jul 21, 2026
186 checks passed
@Phlip79
Phlip79 deleted the philip/stabilize-perf-warmup branch July 21, 2026 04:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants