Skip to content

LayerSmith 0.6.0

Choose a tag to compare

@r0lfi r0lfi released this 15 Oct 12:09
· 17 commits to main since this release

The NVIDIA GPU & LLM Benchmark template grows into a full benchmark suite.

In the benchmark image (gpu-bench)

  • Interactive terminal dashboard, started by default when the container runs in a terminal (podman run --rm -it …): system overview, live GPU status, health, and every benchmark from one screen.
  • Run history (gpu-bench runs), comparisons, topology (gpu-bench topology) and local models (gpu-bench models).
  • Multi-node NCCL collectives with torchrun (gpu-bench dist, no MPI or SSH needed), plus Slurm, MPI and Podman multi-node scripts under /opt/gpu-bench/scripts.
  • Reworked LLM (vLLM), compute, memory and NCCL benchmarks and HTML/JSON/CSV reports. nvbandwidth replaces bandwidthTest.

In LayerSmith

  • The build page explains how to download, verify (sha256sum -c) and podman load the image. There is a new export.sha256 download.
  • GPU benchmark builds check free disk space before they start. LAYERSMITH_GPU_MIN_FREE_GB overrides the check.

Verified for this release: backend and client test suites, the frontend build, and a real Podman build of the benchmark image (10.1 GB, 4.6 GB export). Inside that image the toolchain was checked offline, the dashboard renders, and on a host without a GPU, health and full report clearly what is missing. No GPU hardware was available, so this release has no measured GPU numbers.

Full Changelog: v0.5.0...v0.6.0