[Klaud Cold] Update dsv4-fp4-b200-sglang-agentic-hicache-mtp SGLang image to v0.5.19-cu130 / 将 dsv4-fp4-b200-sglang-agentic-hicache-mtp 的 SGLang 镜像更新至 v0.5.19-cu130 - #3012
Conversation
…to v0.5.19-cu130 Replace the 2026-08-27 dev nightly lmsysorg/sglang:nightly-dev-20260827-20621aa1 with the v0.5.19 release image lmsysorg/sglang:v0.5.19-cu130 (Docker Hub digest sha256:d6e7288627be8b02be88e4bba38e73f6d50e2826869f753c13a4c4385ab3eda9). The release branch contains every commit of the pinned nightly; model, DSpark speculative settings, HiCache profiles, search space and runner are unchanged. 将 dsv4-fp4-b200-sglang-agentic-hicache-mtp 的 SGLang 镜像从 2026-08-27 的开发 nightly lmsysorg/sglang:nightly-dev-20260827-20621aa1 更新至 v0.5.19 正式版镜像 lmsysorg/sglang:v0.5.19-cu130(Docker Hub digest sha256:d6e7288627be8b02be88e4bba38e73f6d50e2826869f753c13a4c4385ab3eda9)。 发布分支包含该 nightly 的全部提交;模型、DSpark 投机解码设置、HiCache 配置、 搜索空间与 runner 均保持不变。 Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
|
Thanks for the contribution! Please reach out to respective companies' CODEOWNER to fill in the latest PR_REVIEW_CHECKLIST.md before pinging core maintainer on Slack for review. In order for the signoff PR check bot to trigger, you must follow the PR_REVIEW_CHECKLIST.md template correctly, including the phrase For PR verification, add the PR authors are responsible for ensuring that after merging, all GitHub Action jobs fully pass. A lot of the time, failures are just flakes and simply re-running the failed jobs will fix it. See GitHub's docs on re-running failed jobs 感谢你的贡献!请联系相应公司的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md,然后再在 Slack 上联系核心维护者进行审阅。为了触发 signoff PR 检查机器人,你必须正确遵循 PR_REVIEW_CHECKLIST.md 模板,包括保留英文语句 如需进行 PR 验证,请为此 PR 添加 PR 作者有责任确保合并后所有 GitHub Action 任务完全通过。 很多时候失败只是偶发抖动(flake),重新运行失败的任务即可解决。参见 GitHub 关于重新运行失败任务的文档 |
Initial attempt
Dropped request counts are the warmup records excluded by AIPerf accounting (no error drops). GPU prefix-cache hit rate: 0.978 / 0.973 / 0.863 vs baseline 0.964 / 0.959 / 0.876.
初始尝试
被剔除的请求为 AIPerf 统计中排除的预热记录(无错误剔除)。GPU 前缀缓存命中率:0.978 / 0.973 / 0.863,基线为 0.964 / 0.959 / 0.876。
|
…te to v0.5.19-cu130 Append the perf-changelog entry for the B200 DeepSeek-V4-Pro-0813 SGLang AgentX image update in PR #3012 after the targeted smoke run passed. 在定向冒烟运行通过后,为 PR #3012 中 B200 DeepSeek-V4-Pro-0813 SGLang AgentX 的镜像更新追加 perf-changelog 条目。 Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
…mage bump branch Resolve the perf-changelog.yaml append conflict by restoring main's file and re-appending only this branch's entry, so the labeled PR can trigger run-sweep. 通过恢复 main 的 perf-changelog.yaml 并仅重新追加本分支条目来解决追加冲突, 使带标签的 PR 能够触发 run-sweep。 Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
|
Milestone — final sweep unblocked by merging main. After the Initial attempt smoke passed, the changelog entry was pushed as 里程碑——通过合并 main 解除最终扫描阻塞。 初始尝试冒烟通过后,changelog 条目以 |
Final full sweep
最终完整扫描
|
|
see unofficial run visualizer at https://inferencex.semianalysis.com/inference?unofficialRun=34603861241 |
|
Final full sweep · Passed · Run 34603861241 / attempt 1 · 2026-09-11 20:34 UTC
Note: All rows: Δ N/A: no matched baseline.
Note: All rows: Δ N/A: no matched eval baseline. Next: Mark ready for maintainer review. 中文最终完整 sweep · 已通过 · Run 34603861241 / attempt 1 · 2026-09-11 20:34 UTC |
|
validated · Repairs: unknown · Runs: 34593186565, 34603861241 中文validated · 修复次数:unknown · 运行:34593186565, 34603861241 |
There was a problem hiding this comment.
Looks good, straightforward version-bump config change. Verified: the image bump in configs/nvidia-master.yaml (dsv4-fp4-b200-sglang-agentic-hicache-mtp) is single-node with no model.container field to keep in sync; the perf-changelog.yaml entry is appended after the last existing entry with no prior bytes touched. Checked whether the new tag should be digest-pinned like dsv4-fp4-gb300-dynamo-sglang-agentic-agg — the same bare lmsysorg/sglang:v0.5.19-cu130 tag (no digest) is already used by six other recipes in this file, so the bare tag here is consistent with the repo's dominant pattern rather than an outlier.
Extended reasoning...
Overview
The diff touches two files: a one-line image tag bump for the dsv4-fp4-b200-sglang-agentic-hicache-mtp recipe in configs/nvidia-master.yaml, and a corresponding perf-changelog.yaml entry appended at the tail. No scripts, Slurm labels, or model/search-space fields changed.
Security risks
None. This is a Docker image tag reference change and a changelog append; no code execution paths, credentials, or auth logic are touched.
Level of scrutiny
This warrants light scrutiny consistent with a mechanical version bump: confirm the changelog is append-only (verified — new entry follows the last pre-existing entry with no byte changes to prior content), confirm no model.container desync (not applicable — recipe is single-node), and check the one candidate issue already surfaced (bare vs. digest-pinned tag) against the rest of the file.
Other factors
I independently confirmed the bare-tag candidate issue that was already ruled out: lmsysorg/sglang:v0.5.19-cu130 without a digest appears in six other recipe blocks in nvidia-master.yaml, and only dsv4-fp4-gb300-dynamo-sglang-agentic-agg pins the digest — so the bare tag in this diff matches the dominant existing convention, not an anomaly specific to this PR. No third-party CHANGES_REQUESTED or unresolved objection is visible in the timeline metadata, and the bug hunter reported zero findings with a dry_streak exit.
Update the
dsv4-fp4-b200-sglang-agentic-hicache-mtpimage from the 2026-08-27 dev nightlylmsysorg/sglang:nightly-dev-20260827-20621aa1to the SGLang v0.5.19 release imagelmsysorg/sglang:v0.5.19-cu130(Docker Hub digestsha256:d6e7288627be8b02be88e4bba38e73f6d50e2826869f753c13a4c4385ab3eda9, pushed 2026-09-04). Model, DSpark speculative decoding, HiCache profiles, search space and runner are unchanged.Baseline
workflow-info?date=2026-09-08&benchmarkType=agentic_traces,benchmarks?model=DeepSeek-V4-Pro&date=2026-09-08&exact=true&sequence=agentic-traces,evaluations?model=DeepSeek-V4-Pro&date=2026-09-08)lmsysorg/sglang:nightly-dev-20260827-20621aa1(sglang commit20621aa1, 2026-08-27)v0.5.19at0bcd8223; the release is 317 commits ahead of and 0 behind the pinned nightly (compare)cluster:b200-nscale; TP8 no offload (c1-5), TP8 HiCache DRAM (c8-16), TP8/EP8/DP-attention HiCache DRAM with sglang-router 0.3.2 (c64-160)874e8a66297b79ff38fcb9b608396c35430e24cd(Use DSpark6 for B200 DSV4 SGLang AgentX / B200 DSV4 SGLang AgentX 使用 DSpark6 #2821)disagg: true, which mismatches the single-node aggregated recipe; the run itself is the aggregated job.将
dsv4-fp4-b200-sglang-agentic-hicache-mtp的镜像从 2026-08-27 的开发 nightlylmsysorg/sglang:nightly-dev-20260827-20621aa1更新至 SGLang v0.5.19 正式版镜像lmsysorg/sglang:v0.5.19-cu130(Docker Hub digestsha256:d6e7288627be8b02be88e4bba38e73f6d50e2826869f753c13a4c4385ab3eda9,2026-09-04 推送)。模型、DSpark 投机解码、HiCache 配置、搜索空间与 runner 均保持不变。基线
workflow-info?date=2026-09-08&benchmarkType=agentic_traces、benchmarks?model=DeepSeek-V4-Pro&date=2026-09-08&exact=true&sequence=agentic-traces、evaluations?model=DeepSeek-V4-Pro&date=2026-09-08)lmsysorg/sglang:nightly-dev-20260827-20621aa1(sglang 提交20621aa1,2026-08-27)v0.5.19,提交0bcd8223;发布版本领先所固定 nightly 317 个提交、落后 0 个(对比)cluster:b200-nscale;TP8 无卸载(c1-5)、TP8 HiCache DRAM(c8-16)、TP8/EP8/DP-attention HiCache DRAM 配 sglang-router 0.3.2(c64-160)874e8a66297b79ff38fcb9b608396c35430e24cd(Use DSpark6 for B200 DSV4 SGLang AgentX / B200 DSV4 SGLang AgentX 使用 DSpark6 #2821)disagg: true,与单节点聚合配方不符;该运行本身是聚合作业。🤖 Generated with Claude Code
Note
Low Risk
Config-only Docker pin plus changelog; no application code or benchmark script edits in the diff.
Overview
Pins
dsv4-fp4-b200-sglang-agentic-hicache-mtpto the release imagelmsysorg/sglang:v0.5.19-cu130, replacing thenightly-dev-20260827-20621aa1dev build. Model, agentic-coding search space, HiCache/MTP/DSpark benchmark recipe, andcluster:b200-nscalerunner are unchanged.Adds a
perf-changelog.yamlentry for this config key noting the image swap and that the benchmark script flags stay the same while the container bumps DeepGEMM (0.1.5.post2 → 0.1.7), FlashInfer (0.6.17 → 0.6.18), and routes W4A4 MXFP4 MegaMoE through--enable-w4a4-mxfp4-megamoeinstead ofDG_USE_FP4_ACTS/DG_USE_MXF4_KINDenv vars.Reviewed by Cursor Bugbot for commit da239a6. Bugbot is set up for automated code reviews on this repo. Configure here.