Skip to content

v0.8.2 — Models in the GPU benchmark wizard

Choose a tag to compare

@r0lfi r0lfi released this 16 Oct 12:36
· 6 commits to main since this release

The GPU benchmark flow in one go: choose models where you choose the image, and the GPU kit is ready when the build is.

  • LLM models in the GPU benchmark wizard — an LLM models card with the H200 list (size, precision, GPUs needed, what is still to download and the free space). Ticked models start downloading when you press Build and run alongside it; they are stored with the project (gpu_benchmark.models, never part of the image).
  • The GPU kit fills itself in — a GPU benchmark build is split into image parts as soon as it is ready, and the models chosen in the wizard are ticked in the kit as soon as their download finishes (the kit lists the ones still pending). One download-all.sh, then bash setup.sh on the GPU host.
  • The wizard's size note now says the .tar is about half the unpacked image, and that loading needs the unpacked size free.
ghcr.io/r0lfi/layersmith:0.8.2