Skip to content

snapdec 0.5.0 — Decision 2.0 local backend

Choose a tag to compare

@aktonay aktonay released this 07 Oct 02:31
· 2 commits to main since this release

What's new

Decision 2.0 family as a third managed local backend (decision2, port 8903) — the vllm-sr Apache-2.0 decision models (Kai 0.6B / Eos 0.8B / Sol 2B / Nox 4B), each pinned to an exact commit SHA. The repos ship a modeling file but no server, so snapdec authors the serve shim (d2serve): loopback-only, fail-closed, wire-compatible with the existing System One contract — no daemon or protocol changes.

Highlights

  • snapdec init --backend local --model vllm-sr/Decision-2.0-Eos-0.8B provisions and serves Eos on this-machine hardware; the wizard lists what actually fits (16 GB RAM gets Kai/Eos/Sol, hides Nox).
  • Measured on i5-13420H / 16 GB / Intel UHD: Kai p50 5.8 s, Eos p50 7.4 s per item (bench runs committed under docs/benchmarks/) — honest slow on CPU marking on every variant.
  • Timeout fix: local backends now default to a 60 s request timeout (was 5 s hardcoded) — the 8-way CLI fan-out no longer produces failure envelopes against CPU-served models.
  • Windows fix: worked around an upstream vllm-sr fingerprint bug that made every Windows full-checkpoint load fail identity verification, without weakening per-file SHA-256 checks (ADR-0010 §8).

Full changelog: CHANGELOG.md. Design record: ADR-0010.

🤖 Generated with Claude Code