Skip to content

lmgw 0.4.0

Choose a tag to compare

@github-actions github-actions released this 05 Oct 13:56
· 16 commits to main since this release

Voice: talk to your models, in the app and over the API.

  • Realtime voice API. /v1/realtime speaks OpenAI's Realtime protocol over a WebSocket and answers with your own models: turn detection inside lmgw (Silero VAD, and Smart Turn for semantic_vad), speech to text, a chat model with tools, and text to speech. Interrupting cuts the answer, and the history keeps only what was heard.
  • Voice in the Chat. Dictation into the composer, read-aloud of replies (code blocks and tables are announced, not read), and a voice mode that talks with the open thread. Choose the microphone and the output in the app. Each thread can have its own speech models, voice, style and languages: the language you speak and the one the reply is spoken in can differ. A local model that hears audio can get your voice turn as audio (a setting, off by default).
  • Natural speech output. Replies go to text to speech in whole sentences, several to a request, and the silence an engine pads its audio with is capped by a new setting, Settings → Realtime → Longest pause.
  • Audio models. Catalog downloads follow the revision a model's spec pins, a package can be completed in one go, and an audio model can run on the CPU with its own thread count, where it keeps serving while the GPU hold is on.
  • Many fixes around audio containers, the GPU hold and the catalog.

Download the RPM below and install it with sudo dnf install ./lmgw-*.x86_64.rpm, or let the app offer the update. The README has the voice setup.