Repository navigation
LayerSmith 0.6.0
The NVIDIA GPU & LLM Benchmark template grows into a full benchmark suite.
In the benchmark image (gpu-bench)
- Interactive terminal dashboard, started by default when the container runs in a terminal (
podman run --rm -it …): system overview, live GPU status, health, and every benchmark from one screen. - Run history (
gpu-bench runs), comparisons, topology (gpu-bench topology) and local models (gpu-bench models). - Multi-node NCCL collectives with torchrun (
gpu-bench dist, no MPI or SSH needed), plus Slurm, MPI and Podman multi-node scripts under/opt/gpu-bench/scripts. - Reworked LLM (vLLM), compute, memory and NCCL benchmarks and HTML/JSON/CSV reports.
nvbandwidthreplacesbandwidthTest.
In LayerSmith
- The build page explains how to download, verify (
sha256sum -c) andpodman loadthe image. There is a newexport.sha256download. - GPU benchmark builds check free disk space before they start.
LAYERSMITH_GPU_MIN_FREE_GBoverrides the check.
Verified for this release: backend and client test suites, the frontend build, and a real Podman build of the benchmark image (10.1 GB, 4.6 GB export). Inside that image the toolchain was checked offline, the dashboard renders, and on a host without a GPU, health and full report clearly what is missing. No GPU hardware was available, so this release has no measured GPU numbers.
Full Changelog: v0.5.0...v0.6.0