Skip to content

Conversation

@mmarcinkiewicz
Copy link
Contributor

@mmarcinkiewicz mmarcinkiewicz commented Jul 22, 2025

Adding RCPs for GBS1152 and 2304 obtained with updated evaluation schema.

@mmarcinkiewicz mmarcinkiewicz requested review from a team as code owners July 22, 2025 12:14
@github-actions
Copy link

github-actions bot commented Jul 22, 2025

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

@mmarcinkiewicz mmarcinkiewicz changed the title Create rcps_llama31_405b.json [Draft]: Create rcps_llama31_405b.json Jul 22, 2025
@ShriyaRishab
Copy link
Contributor

ShriyaRishab commented Jul 22, 2025

@mmarcinkiewicz can you rebase with master and resolve conflicts?

ShriyaRishab
ShriyaRishab previously approved these changes Aug 1, 2025
Copy link
Contributor

@ShriyaRishab ShriyaRishab left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Waiting for GBS 4k

@mmarcinkiewicz mmarcinkiewicz changed the title [Draft]: Create rcps_llama31_405b.json Create rcps_llama31_405b.json Aug 3, 2025
@mmarcinkiewicz
Copy link
Contributor Author

@ShriyaRishab GBS4608 added, conflicts resolved

@ShriyaRishab
Copy link
Contributor

@mmarcinkiewicz - since the variance looks higher than before, what is the proposed submission runs N? We will need 2N RCP runs for all 3 batch sizes

@hiwotadese hiwotadese merged commit ff57824 into mlcommons:master Aug 7, 2025
1 check passed
@github-actions github-actions bot locked and limited conversation to collaborators Aug 7, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants