Skip to content

LLM post training RCP logs and finalized description - #895

Merged
ShriyaRishab merged 5 commits into
mlcommons:masterfrom
al-rigazzi:qwen35_397b_grpo_logs
Jul 27, 2026
Merged

LLM post training RCP logs and finalized description#895
ShriyaRishab merged 5 commits into
mlcommons:masterfrom
al-rigazzi:qwen35_397b_grpo_logs

Conversation

@al-rigazzi

Copy link
Copy Markdown
Contributor

Summary

Finalizes the description and reproducibility instructions for the Qwen 3.5 397B GRPO post-training benchmark.

Included

  • Adds RCP logs for six replicas at each of GBS 256, 512, and 1024.
  • Updates the NeMo-RL submodule to the qualified implementation at 3fca04c9b.
  • Expands the benchmark description, system-independent setup instructions, configuration details, and timing methodology.
  • Documents the exact model, datasets, Gym/OpenHands prompts, validation metric, and rollout-completion requirements used for the RCPs.
  • Adds helpers for downloading the checkpoint and datasets and verifying dataset identity.
  • Adds detailed instructions for building the container and launching reproducible RCP runs.

@al-rigazzi
al-rigazzi requested review from a team as code owners July 24, 2026 18:14
@github-actions

github-actions Bot commented Jul 24, 2026

Copy link
Copy Markdown

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

@ShriyaRishab

Copy link
Copy Markdown
Contributor

Can you please rename the benchmark folder to match the agreed upon name?

ShriyaRishab
ShriyaRishab previously approved these changes Jul 24, 2026
@al-rigazzi

Copy link
Copy Markdown
Contributor Author

Can you please rename the benchmark folder to match the agreed upon name?

Totally an oversight from me.

@jepio could you do this? I don't have easy access to code for one week.

@ShriyaRishab

Copy link
Copy Markdown
Contributor

I can make the change!
But you need to sign the CLA for us to be able to merge your MR.

…etails

Signed-off-by: ShriyaRishab <spalsamudram@nvidia.com>
@ShriyaRishab
ShriyaRishab force-pushed the qwen35_397b_grpo_logs branch from 3107bfd to b820f64 Compare July 25, 2026 00:32
@al-rigazzi

Copy link
Copy Markdown
Contributor Author

I can make the change!

But you need to sign the CLA for us to be able to merge your MR.

I have enrolled into MLCommons and I believe I was added to the CLA. I haven't received a separate request for it.

@al-rigazzi

Copy link
Copy Markdown
Contributor Author

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

@ShriyaRishab seems to have worked

@ShriyaRishab
ShriyaRishab merged commit aa344c7 into mlcommons:master Jul 27, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants