Skip to content

Studio 4.7: correct multi-replica sizing, library v24, publishing polish

Choose a tag to compare

@mahmoudyassine mahmoudyassine released this 18 Jul 10:36

Correctness release, verified by a multi-agent adversarial review plus an automated engine harness.

Engine v23

  • Multi-replica accounting fixed. Total VRAM now charges weights and activations per data-parallel replica instead of once per fleet. Fit verdicts for multi-worker configurations were previously far too optimistic (4 replicas of Llama 3.1 70B BF16 need 563 GB of weights, not 140). The batch chart's memory limit, admission guidance and topology utilization inherit the correction.
  • Capacity counts serving GPUs only (replicas x TP); idle-GPU VRAM is no longer credited.
  • New warning when resident sequence plus reasoning exceeds the model's max context; MHA per-token KV insight corrected (was overstated 1000x).
  • The Excel export mirrors every change cell-for-cell.

Library v24

  • Llama 3.1 405B kvHeads 16 -> 8 · Llama 4 Scout/Maverick headDim 256 -> 128, Maverick hidden 8192 -> 5120 · Qwen3-Next 80B effective KV -> 2x64 · RTX PRO 6000 Blackwell SE dense TFLOPS 500 -> 250 · GGUF Q5_K_S/Q3_K_S sizes · Gemma 3 arch labels.

Robustness

  • Topology frames truncate mirror/standby/DR cards correctly (no more "+-1 more").
  • Every slider-backed input clamps through its field config: typed out-of-range or cleared values cannot desync the engine from the display or produce NaN.
  • Printing from dark mode auto-switches to light for the snapshot and restores after; imported themes lock against OS scheme changes; hardened single-file build.

Design and publishing

  • Redesigned header (version chip, grouped toolbar, GitHub link) and a three-column footer.
  • Social share cards (dedicated 1200x630 OG image), web manifest, branded 404, robots.txt.
  • Rewritten README with live demo, screenshot, worked example and architecture diagram; schemas in docs/DATA.md; Cloudflare DNS import file for gpuscale.net.