Repository navigation
snapdec 0.5.0 — Decision 2.0 local backend
What's new
Decision 2.0 family as a third managed local backend (decision2, port 8903) — the vllm-sr Apache-2.0 decision models (Kai 0.6B / Eos 0.8B / Sol 2B / Nox 4B), each pinned to an exact commit SHA. The repos ship a modeling file but no server, so snapdec authors the serve shim (d2serve): loopback-only, fail-closed, wire-compatible with the existing System One contract — no daemon or protocol changes.
Highlights
snapdec init --backend local --model vllm-sr/Decision-2.0-Eos-0.8Bprovisions and serves Eos on this-machine hardware; the wizard lists what actually fits (16 GB RAM gets Kai/Eos/Sol, hides Nox).- Measured on i5-13420H / 16 GB / Intel UHD: Kai p50 5.8 s, Eos p50 7.4 s per item (bench runs committed under docs/benchmarks/) — honest
slow on CPUmarking on every variant. - Timeout fix: local backends now default to a 60 s request timeout (was 5 s hardcoded) — the 8-way CLI fan-out no longer produces failure envelopes against CPU-served models.
- Windows fix: worked around an upstream vllm-sr fingerprint bug that made every Windows full-checkpoint load fail identity verification, without weakening per-file SHA-256 checks (ADR-0010 §8).
Full changelog: CHANGELOG.md. Design record: ADR-0010.
🤖 Generated with Claude Code