Repository navigation
lmgw 0.4.1
Tools in voice conversations, llama.cpp as a backend of its own, and an app window that feels native.
- Tools in voice conversations. A
/v1/realtimesession can offer MCP tools the way OpenAI's Realtime API does ({"type": "mcp"}): lmgw runs the calls on its own MCP servers, by label, and reports them asmcp_callitems; the client sends the follow-up.GET /v1/mcp/serversand/v1/mcp/servers/{label}list the servers and their tools for a client's picker./v1/responsesnow takesallowed_toolsas{tool_names: [...]}too and refuses a malformed one instead of allowing every tool. - llama.cpp gets its own backend. llama-server rows speak their own protocol (existing rows migrate on start): what a model can do comes from the server's
/props, and images returned by tools reach a model that sees them. ik_llama.cpp rows use the same path. - Configured fallbacks always apply. A fallback that cannot see gets placeholders for the images (a PDF's pages go as its text) instead of the request waiting for the local model, and the response header
x-lmgw-images-omittedcounts them. A voice turn goes as audio to whichever model answers if it hears audio, cloud and LAN models included (the setting is now off/on, a storedlocalreads as on); otherwise it goes as the transcript. Voice-clip transcription follows the configured fallback. The Traffic page marks every request whose content was reduced this way. - No orphaned model containers. A client that hangs up while its model loads no longer leaves the container running unregistered, which used to block that model with
vram_queue_timeout. After start, lmgw adopts or removes the containers it owns, and a request its client gave up on is logged as a 499 row. - A native app window on KDE. KWin draws the frame, the app uses the desktop's fonts and the title bar's colours, the traffic pulse and the GPU status sit at the foot of the sidebar, right-click gives a desktop menu instead of a browser's, the window opens fully drawn, and the scrollbars are thin. The default interface scale is now 125%.
- Browser clients with a gateway key. CORS preflights now echo the requested headers, so a browser can send
Authorization.
Download the RPM below and install it with sudo dnf install ./lmgw-*.x86_64.rpm, or let the app offer the update.