Skip to content

Kai mobile 0.1.1

Choose a tag to compare

@github-actions github-actions released this 19 Oct 07:33
· 1 commit to main since this release

Kai mobile's first release. (The v0.1.0 tag was never released: its build failed in the APK check, which 0.1.1 fixes; the app is the same.)

Kai mobile is an Android client of lmgw: voice first, and able to be the phone's digital assistant. This is its first release, an alpha.

  • Pairing over lmgw's device link. Scan the QR code on lmgw's Devices card, tap a pairing link or paste it. Kai shows what it is about to pair with, makes a non-exportable P-256 key in the Android Keystore, enrols it with the one-time token and keeps a certificate. You confirm a short code on lmgw's Devices card. It tries the link's URLs (LAN, VPN) in parallel and follows the one that answers.
  • Text conversations. The ongoing Kai conversation of your lmgw's Chat, shared with Kai on the desktop: Markdown replies, tool notices under the answer, New conversation, and a notice when a tool of a device is not granted or offline.
  • Voice over WebRTC calls. Automatic turn-taking, push-to-talk, mute, stopping Kai by speaking, captions, and a ring that follows the voice. If another device holds the conversation's call, Take over asks first. Echo cancelling (software, or half duplex), Bluetooth and headset routing, headset buttons and audio focus are handled: another app's audio pauses the call instead of ending it.
  • Kai as your digital assistant. Set Kai as the assistant in Android's settings (a card in the app walks through it): its overlay opens from the assistant gesture, a quick settings tile or a launcher shortcut. Closing it before you spoke ends the call; after a turn the call goes on, and Expand moves it into the app.
  • Tool notices and approvals. A tool call that needs a decision shows one card on the overlay, the voice screen and in the conversation, and as a notification with Approve and Decline. Approving needs an unlocked phone; declining works locked.
  • Notifications through the Chat feed. A foreground service holds the feed open, so replies and approvals reach you with the app closed, with no push provider in between. Notifications show no content on the lock screen.
  • Two-screen layouts, TalkBack and font-scale support.

Requirements:

  • lmgw 0.5.0 or later, with its device listener on and a Chat model; voice needs speech-to-text and text-to-speech models.
  • Android 12 (API 31) or later, arm64.
  • A network path to lmgw: the same LAN, or a VPN such as WireGuard. Calls use UDP and lmgw has no STUN or TURN, so the phone must reach lmgw directly.

Install: download the APK from this release and sideload it (allow installs from this source). Updating is installing the next APK over it; there is no in-app updater yet.

Known gaps: images and attachments in messages, a spoken yes or no for approvals (use the card or the notification), a thread browser and search, a local message cache (the conversation is read again at start), Markdown tables, phone tools (alarms, calendar and the like), screen context for the assistant, the lock screen as a place to talk, and automatic certificate renewal (you pair again when it lapses, after about a year). Whether your phone maker lets the side button or power key reach the assistant varies. There is no iOS app.