v0.3.1 — Experimental Browser Inference
Experimental browser inference
v0.3.1 adds gated, opt-in, in-browser Decision Brief generation using WebGPU and WebLLM.
Included
- Preferred browser model: Qwen3.5-4B-q4f16_1-MLC
- Split-stage Capture Layer and Decision Brief generation
- Strict structured-output parsing and validation
- Automatic targeted correction of failing brief sections
- Browser model-load and completion diagnostics
- Model-specific download disclosure
- Deterministic Recommendation, Suggested Next Steps, and Decision Trace assembly
- Three browser-compatible public examples:
- Household Move Planning
- Q4 Workforce Allocation
- Local Inference Setup Flow
Validation
- 616 automated tests passed
- TypeScript typecheck passed
- Production build passed
- Mock evaluation passed all 10 cases
- GitHub CI passed
- Preferred model completed all 3 supported public examples in Chrome on an RTX 3080 Ti
- First model load completed in about 92 seconds
- Cached model load completed in about 12 seconds
Current limitations
- Mock remains the default generation mode.
- Browser inference is experimental and explicitly opt-in.
- Browser inference currently supports short-to-medium notes.
- Long-form browser inference is deferred to #166.
- User-visible cancellation during generation is not included in this release.
- Browser output quality may be weaker than Local Ollama and still requires user review.