Skip to content

v1.4.4

Choose a tag to compare

View all tags
@airiclenz airiclenz released this 13 Jun 14:10
· 138 commits to main since this release
v1.4.4
666c562

Optional MCP control-plane adapter (llama-launcher-mcp)

A separate, optional host-side binary (make build-mcp) that exposes llama-launcher's lifecycle commands as MCP tools over HTTP, so a client on another machine — typically a coding agent in a container — can control which model runs on the host. It shells out to the CLI and dispatches control commands only, never proxying inference, so llama-launcher itself keeps no listener and ADR-0002 stays intact (see ADR-0008).

  • Tools: list_profiles, server_status, tail_log (read) plus load_profile, unload_model, start_server, stop_server (mutating, omitted under --read-only).
  • Access: source-IP allowlist, no token — --allow <ip|cidr|host> or --allow-interface <name> to allow a local bridge's subnet (covers any IP the bridge assigns the container, nothing to pin). Listener binds the container-facing interface via --listen (not 0.0.0.0).

The Homebrew formula installs the llama-launcher CLI only; build the adapter with make build-mcp.

Assets 2
Loading