Skip to content

lmgw 0.4.1

Choose a tag to compare

@github-actions github-actions released this 06 Oct 20:51
· 14 commits to main since this release

Tools in voice conversations, llama.cpp as a backend of its own, and an app window that feels native.

  • Tools in voice conversations. A /v1/realtime session can offer MCP tools the way OpenAI's Realtime API does ({"type": "mcp"}): lmgw runs the calls on its own MCP servers, by label, and reports them as mcp_call items; the client sends the follow-up. GET /v1/mcp/servers and /v1/mcp/servers/{label} list the servers and their tools for a client's picker. /v1/responses now takes allowed_tools as {tool_names: [...]} too and refuses a malformed one instead of allowing every tool.
  • llama.cpp gets its own backend. llama-server rows speak their own protocol (existing rows migrate on start): what a model can do comes from the server's /props, and images returned by tools reach a model that sees them. ik_llama.cpp rows use the same path.
  • Configured fallbacks always apply. A fallback that cannot see gets placeholders for the images (a PDF's pages go as its text) instead of the request waiting for the local model, and the response header x-lmgw-images-omitted counts them. A voice turn goes as audio to whichever model answers if it hears audio, cloud and LAN models included (the setting is now off/on, a stored local reads as on); otherwise it goes as the transcript. Voice-clip transcription follows the configured fallback. The Traffic page marks every request whose content was reduced this way.
  • No orphaned model containers. A client that hangs up while its model loads no longer leaves the container running unregistered, which used to block that model with vram_queue_timeout. After start, lmgw adopts or removes the containers it owns, and a request its client gave up on is logged as a 499 row.
  • A native app window on KDE. KWin draws the frame, the app uses the desktop's fonts and the title bar's colours, the traffic pulse and the GPU status sit at the foot of the sidebar, right-click gives a desktop menu instead of a browser's, the window opens fully drawn, and the scrollbars are thin. The default interface scale is now 125%.
  • Browser clients with a gateway key. CORS preflights now echo the requested headers, so a browser can send Authorization.

Download the RPM below and install it with sudo dnf install ./lmgw-*.x86_64.rpm, or let the app offer the update.