Skip to content

TandemLLM 0.9.2

Choose a tag to compare

@0xBakeer 0xBakeer released this 15 Oct 16:57
· 430 commits to main since this release

TandemLLM 0.9.2 fixes two install bugs that an early tester hit on a new DGX Spark with 0.9.1. The engine, the conductor and the dashboard do not change. Every change is in CHANGELOG.md, and the PDF below is the manual.

Fixes

  • Checksums: fetch_weights.py compared a download's file globs to file names as plain text. Qwen3.5-0.8B (the shadow reader) and Qwen3.5-2B (the narrator) list only globs, so their download checked no file and stopped with 0 files checked: FAILED. Laya's files under multilingual/ and typed-decisions/ were never checked. Now the globs pick the files to check.
  • EXL3 after install.sh --setup: the 27B's EXL3 profiles refused to switch, with base-plain already on disk. The installer wrote QWEN38_MODEL, an empty Hugging Face cache folder on a new box, after the weight profile, so the profile could not replace it. The installer's keys now come before the profile, and an EXL3 profile reads base-plain when that folder has no FP8 snapshot. A standalone community pack now reads its own folder on an installed box too.
  • HF_HOME: an install with HF_HOME or HF_HUB_CACHE set writes that cache to run/ops/serve.env. A later shell without the variable fetches the base into the same cache and finds it there.

Upgrade

Run the 0.9.2 installer again. It rewrites run/ops/serve.env and the scripts beside it; a git checkout of the tag keeps the old ones. On a box you installed with --setup:

curl -fsSLO https://raw.githubusercontent.com/0xBakeer/TandemLLM/v0.9.2/install.sh
bash install.sh --setup --force-setup --yes
~/TandemLLM/run/ops/use-profile.sh <profile>

A box installed without --setup upgrades with bash install.sh --yes and the same --dir. On a new DGX Spark:

curl -fsSLO https://raw.githubusercontent.com/0xBakeer/TandemLLM/v0.9.2/install.sh
bash install.sh --setup --yes
~/TandemLLM/run/ops/use-profile.sh exl3-4.5 --dry-run   # each file's URL and size
~/TandemLLM/run/ops/use-profile.sh exl3-4.5

Known limits

The limits of 0.9.1 still hold: see its release notes.