Skip to content

[AMD/ROCm] kimik2.5-fp4-mi355x-atom. Bump ATOM image to rocm/atom:rocm7.2.3_ubuntu24.04_py3.12_pytorch_release_2.10.0_atom20260511 - #1387

Merged
cquil11 merged 5 commits into
mainfrom
kimik2.5-fp4-mi355x-atom-nightly-20260511
May 19, 2026
Merged

[AMD/ROCm] kimik2.5-fp4-mi355x-atom. Bump ATOM image to rocm/atom:rocm7.2.3_ubuntu24.04_py3.12_pytorch_release_2.10.0_atom20260511#1387
cquil11 merged 5 commits into
mainfrom
kimik2.5-fp4-mi355x-atom-nightly-20260511

Conversation

@seungrokj

Copy link
Copy Markdown
Collaborator

Summary

Bumps the ATOM docker image for kimik2.5-fp4-mi355x-atom from:

rocm/atom:rocm7.2.1-ubuntu24.04-pytorch2.9.1-atom0.1.2

to:

rocm/atom-dev:nightly_202605111702

Performance vs previous InferenceX data

Based on comparing InferenceX benchmark (date: 2026-04-01) against ATOM upstream run #25686894636 (2026-05-11, rocm/atom-dev:nightly_202605111702):

ISL OSL Conc GPUs (tp) IX tput/GPU ATOM tput/GPU Δ
1024 1024 4 4 189.05 212.56 +12.4%
1024 1024 8 4 287.02 376.15 +31.1%
1024 1024 16 4 456.55 546.70 +19.7%
1024 1024 128 4 1648.44 1645.68 ~0%
8192 1024 4 4 680.48 849.95 +24.9%
8192 1024 8 4 1192.45 1402.76 +17.6%
8192 1024 16 4 1629.17 1960.34 +20.3%
8192 1024 128 4 3510.36 4088.46 +16.5%

No changes to the benchmark script or serve arguments — image bump only.

Bump the ATOM image from rocm/atom:rocm7.2.1-ubuntu24.04-pytorch2.9.1-atom0.1.2
to rocm/atom-dev:nightly_202605111702, matching the latest upstream ATOM
benchmark run (https://github.com/ROCm/ATOM/actions/runs/25686894636).

Performance improvement vs previous InferenceX data (tp=4):
  isl=1024/osl=1024: +12% to +31% at c=4-16, neutral at c=32-128
  isl=8192/osl=1024: +17% to +25% at c=4-16, +17% at c=128
@github-actions

Copy link
Copy Markdown
Contributor

Thanks for the contribution! For vLLM & SGLang, please ensure that your recipes is similar to the official vLLM recipes and/or the SGLang cookbook

If it is not, please create a PR first before we can merge your single node PR into the master branch. Let's ensure that the documentation is first class such that the entire ML community can benefit from your hard work! Thank you

PR authors are responsible for ensuring that after merging, all GitHub Action jobs fully pass. A lot of the time, failures are just flakes and simply re-running the failed jobs will fix it. If re-running failed jobs is attempted, PR authors are responsible for ensuring it passes. See GitHub's docs on re-running failed jobs: https://docs.github.com/en/actions/how-tos/manage-workflow-runs/re-run-workflows-and-jobs#re-running-failed-jobs-in-a-workflow

As a rule of thumb, generally, PR authors should request a review & get a PR approval from the respective companies' CODEOWNERS before requesting a review from core maintainers.

If additional help is needed, PR authors can reach out to core maintainers over Slack.

1 similar comment
@github-actions

Copy link
Copy Markdown
Contributor

Thanks for the contribution! For vLLM & SGLang, please ensure that your recipes is similar to the official vLLM recipes and/or the SGLang cookbook

If it is not, please create a PR first before we can merge your single node PR into the master branch. Let's ensure that the documentation is first class such that the entire ML community can benefit from your hard work! Thank you

PR authors are responsible for ensuring that after merging, all GitHub Action jobs fully pass. A lot of the time, failures are just flakes and simply re-running the failed jobs will fix it. If re-running failed jobs is attempted, PR authors are responsible for ensuring it passes. See GitHub's docs on re-running failed jobs: https://docs.github.com/en/actions/how-tos/manage-workflow-runs/re-run-workflows-and-jobs#re-running-failed-jobs-in-a-workflow

As a rule of thumb, generally, PR authors should request a review & get a PR approval from the respective companies' CODEOWNERS before requesting a review from core maintainers.

If additional help is needed, PR authors can reach out to core maintainers over Slack.

Comment thread perf-changelog.yaml
@seungrokj seungrokj changed the title [kimik2.5-fp4-mi355x-atom] Bump ATOM image to rocm/atom-dev:nightly_202605111702 [AMD/ROCm] kimik2.5-fp4-mi355x-atom. Bump ATOM image to rocm/atom-dev:nightly_202605111702 May 15, 2026
Comment thread .github/configs/amd-master.yaml Outdated
@seungrokj seungrokj changed the title [AMD/ROCm] kimik2.5-fp4-mi355x-atom. Bump ATOM image to rocm/atom-dev:nightly_202605111702 [AMD/ROCm] kimik2.5-fp4-mi355x-atom. Bump ATOM image to rocm/atom:rocm7.2.3_ubuntu24.04_py3.12_pytorch_release_2.10.0_atom20260511 May 16, 2026
@seungrokj seungrokj added the AMD label May 16, 2026
@seungrokj

Copy link
Copy Markdown
Collaborator Author

@cquil11
cquil11 merged commit f5d7fa4 into main May 19, 2026
22 checks passed
@cquil11
cquil11 deleted the kimik2.5-fp4-mi355x-atom-nightly-20260511 branch May 19, 2026 14:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

Development

Successfully merging this pull request may close these issues.

3 participants