Repository navigation
v0.1.0
First public source release of Local Model Gateway.
Highlights:
- OpenAI-compatible
/v1/chat/completions,/v1/responses, and/v1/modelsroutes. - Streamable HTTP MCP endpoint at
/mcpwith setup and runtime tools. - SQLite-backed GPU work queue shared by OpenAI URL requests, MCP runtime jobs, and exclusive llama-cli jobs.
- Managed local runtime coordination with priority/FIFO admission, runtime swaps, max concurrency, cancellation, and status reporting.
- Lazy MCP broker package for compact, policy-gated downstream MCP tool discovery.
- CLI for
init,doctor,start, recipes, and service helpers. - macOS launchd and generic shell runtime adapter helpers.
- README demo showing multiple local clients sharing one gateway endpoint.
Validation before release:
npm run cipassed locally.- GitHub Actions CI passed on
main. - Public safety scan passed.
- Workspace package dry-run passed.
This is a GitHub source release. npm publishing is intentionally left as a follow-up.