Skip to content

Releases

Kai for Firefox 0.1.0

Choose a tag to compare

@github-actions github-actions released this 06 Nov 16:46

The first release of Kai for Firefox.

Kai for Firefox gives Kai, the voice assistant for the KDE Plasma desktop, hands and eyes in Firefox, and puts lmgw's Chat in a sidebar beside the page. Kai can read and operate the pages open in Firefox whether you talk to Kai, type in lmgw's Chat or use Kai on your phone, with the sidebar open or not.

  • Browser tools for Kai. lmgw lists them to models under Kai's label: where you are (your tab, the focus, the selection), tabs, reading (outline, controls, links, fields, the article or all text, tables, find, PDFs in Firefox's viewer), screenshots for a vision model, acting (press, fill, choose, check, attach a file, hover, drag, scroll, keys), numbered hints over the controls in view, Firefox's zoom, Reader view, bookmarks, history and downloads, and source, DOM, CSS and script tools for developers. Every result from a page starts with the tab's title and address, so page text is never mistaken for your words.
  • Hands and eyes. Ask, and Kai acts on the tab in front of you: "read the article", "what does the error say", "open the second result", "fill in the form". With hints shown, "press 14" works.
  • What changed, said out loud. Kai can say on its own that a page loaded, a dialog opened, a field shows an error or the page reported something, without a model turn.
  • Reading aloud. A page read paragraph by paragraph, the paragraph highlighted, with pause, resume and skip.
  • Firefox's own pages and dialogs. Kai reads and presses a page's dialogs, a site's permission prompts and Firefox's own pages through the desktop's accessibility.
  • The Chat beside the page. The sidebar (toolbar button or Ctrl+Alt+K) is lmgw's full Chat in a narrow column: folders, threads, search, tools, approvals, attachments and the composer, the same threads as in lmgw's dashboard and on your phone. New chat starts one in the open thread's folder, and Back to returns to Kai's current conversation. A strip above it shows the tab's site and Kai's rule for it, a Hints switch, and Page, which attaches the page's readable text to the open thread.

Accessibility is a supported use and is tested: acceptance runs through Kai's real tool path search, open a result, read a product and a table, hear a form's errors, fill and submit a form, attach a file and close a cookie banner, with no mouse or keyboard input from the tester.

Requirements:

  • Firefox 154 or newer, as a regular package such as Fedora's RPM. A Flatpak or Snap Firefox cannot reach Kai yet.
  • Kai 0.3.0 or later on the same computer, paired with lmgw. Its RPM installs the native-messaging host and registers it with Firefox.
  • lmgw 0.6.0; the sidebar is built on its Chat.
  • For Firefox's own pages and dialogs, the desktop's accessibility has to be on when Firefox starts.

Install: open kai-firefox.xpi from this release in Firefox and confirm, or use about:addons → ⚙ → Install Add-on From File…. Kai's settings window can also offer it (Firefox → Install Kai for Firefox). The add-on is signed by Mozilla as an unlisted add-on, so it is not on addons.mozilla.org. Firefox updates it from this repository's latest release, as it updates any add-on; pre-releases are not offered. Kai takes the link only from a Firefox that Plasma started (the application menu, a link or autostart), not one started from a terminal.

Privacy and control:

  • The extension talks only to Kai, through Firefox's native messaging. It holds no key or token, opens no connection to lmgw, runs no service of its own, has no telemetry and declares no data collection. Kai reaches lmgw with its own device certificate.
  • What leaves the browser: to Kai, what its tools read (page text, screenshots, fields with passwords and card numbers masked), pages you attach, the change reports while announcements are on, and the sidebar's Chat. A message typed in the sidebar names the tab beside it (its title and address), except on a none site. Through Kai, tool results and the Chat reach your lmgw, which keeps them in the thread and sends them to the thread's model; with a cloud model, page text goes to that provider like the rest of the conversation.
  • Permissions: all sites (to read and act on any page you open), native messaging, tabs, navigation and request events, history, bookmarks, downloads, search, find, storage, and containers with cookies. User scripts, for the script tools, are optional and asked for on the options page.
  • Site rules, set in Kai's settings by host, domain or origin: act (the default) reads and acts, read only reads, none reaches nothing and leaves the site's tabs out of Kai's tab list. A frame gets its own site's rule; a none frame is left out and blanked in screenshots. The rules also apply to Kai's desktop tools on Firefox's windows.
  • What runs without asking: by default, reading runs and everything that acts on a page asks first; attaching a file and the script tools always ask. Kai may act in Firefox without asking, the hands-and-eyes switch in Kai's Firefox section, lets Kai act unasked, but only on the tab you brought to the front, on the site where you last acted. Ask before committing (on by default) asks before Kai presses something named buy, order, pay, delete, send and the like, before a form goes to another site and before a site your history has never seen, and holds the page's writes right after an action for your answer. The guard does not see requests from web workers, WebSocket or WebRTC traffic, scripted GET requests, sendBeacon or link pings.
  • Kai never reads about:logins, the password manager or a password field, and never presses in Firefox's settings or an add-on's prompt.
  • lmgw's admin level: while Kai's admin level is read only or full and Firefox is linked, Kai warns you, because a page's text could steer a model to lmgw's configuration. Setting it to off in lmgw is up to you.

Every page is text from a stranger and can carry instructions aimed at the model. The rules keep the common case quick and the risky steps visible; they do not make such instructions harmless.

Not built yet: other browsers, private windows, Firefox's file and save dialogs and address bar, voice in the sidebar (use Kai's talk key), changing a site's rule from the sidebar's strip, simple commands without a model, and settings per Firefox profile.