Skip to content

v26.06.00

Choose a tag to compare

@bdubauski bdubauski released this 01 Jul 19:26
· 7 commits to main since this release
d67d704

Added

  • Agentic inference recipes for GLM-5 and Kimi-K2.6 short-context TRT-LLM Dynamo, plus Qwen3 long-context SGLang. These recipes are not part of the Exemplar suite at this time.
  • DeepSeek V3 NeMo-RL GRPO workload for GB200.
  • DeepSeek V3 NVL72 GB300 pretrain configuration and 72-GPU weak scaling support for GPT-OSS pretrain.
  • llmb-install support for HuggingFace repository downloads into LLMB-managed workload or shared directories, per-architecture uv binaries, and SLURM-based compute-node architecture detection.
  • llmb-run NeMo-RL performance metrics in job history, including s/iter and Tokens/s/GPU.
  • Workload display names and aliases in metadata, with uniqueness validation and Beacon publishing support.

Changed

  • Updated DeepSeek V3, Llama 3.1, and Nemotron-H Megatron-Bridge recipes to NeMo 26.04.01 where applicable.
  • Refreshed Qwen3, Nemotron 3, Kimi-K2, B200, and NCCL recipe configurations.
  • Optional B300 Priority Core Turbo binding is now controlled with ENABLE_PCT_BINDING=true.

Fixed

  • Improved system info HCA checks for NVSHMEM workloads.

Known Issues

  • EFA limitations remain for DeepSeek V3 (Megatron-Bridge H100, TorchTitan, RL), Nemotron-H, and Qwen3 (30B H100, 235B H100); see Known Issues section of README for details.
  • Optional PCT fixed-core CPU binding may improve select workloads on B300 Granite Rapids systems where PCT is enabled. Validate the cluster's PCT core layout before enabling ENABLE_PCT_BINDING=true or applying the patch described in the README.

Removed

  • DeepSeek R1 inference recipes (Dynamo, SGLang, TRT-LLM), GPT-OSS inference recipes (Slurm, Kubernetes), and Llama 3.3 inference recipe.

End of Support

  • LLMB v26.02.x and earlier are no longer supported as of v26.06.00. These release lines will not receive further updates, fixes, or support.