Skip to content

v1.0.0

Choose a tag to compare

View all tags
@github-actions github-actions released this 03 Sep 18:21
· 16 commits to main since this release
v1.0.0
ab7f820

Quartermaster's first public release.

Run any model without tuning a single flag. Point it at your models folder: every GGUF is
identified from its own header, the VRAM that is actually free is measured, and context length,
GPU offload, CPU-MoE split and KV sizing are computed per model. Models then hot-swap on demand
behind one OpenAI- and Anthropic-compatible API.

  • Text, image and audio in one catalog, served by the inference servers you already trust:
    llama-server, stable-diffusion.cpp, whisper.cpp, vLLM, TabbyAPI, anything that speaks HTTP.
  • One scheduler behind every listener, so everything loaded evicts against a single shared
    VRAM budget instead of colliding.
  • A dashboard and a playground: live VRAM and throughput, per-model tuning, plus chat,
    images, speech and transcription.
  • A Hugging Face browser and managed backends, so a model or a new llama.cpp build is a
    click rather than an afternoon.
  • Self-updating from here on: later releases install themselves from inside the app.

Runs on your hardware. Bring your own models. No telemetry.

Instructions

Download the setup program for your platform:

  • Windows -- quartermaster-setup-windows-amd64-v1.0.0.exe
  • Linux -- quartermaster-setup-linux-amd64-v1.0.0 (or -linux-arm64-v1.0.0)
  • macOS, Apple silicon -- quartermaster-setup-darwin-arm64-v1.0.0

The unix ones need chmod +x first. There is no signed macOS build yet, so
clear the quarantine flag before the first launch:

xattr -d com.apple.quarantine ./quartermaster-setup-darwin-arm64-v1.0.0

SHA256SUMS covers every file here.

The other files, and who they are for

quartermaster-windows-amd64.exe and quartermaster-linux-amd64 /
-linux-arm64 / -darwin-arm64 are the bare server binary, not an
installer. Nothing about them creates a Start Menu entry, a desktop shortcut or
an uninstall record. They are published for two reasons:

  • the in-app updater downloads one to replace the running binary, so a release
    without them silently stops every existing install from updating;
  • a headless Linux or macOS box can run one directly: chmod +x, point it at
    a models folder, and install backends from Settings.

Installing for the first time? Take a quartermaster-setup-... file from
the instructions above.

Assets 11
Loading