Repository navigation
Releases
v0.1.0 — Local Voice for Mac (developer preview)
Fast Computer Use v0.1.0
First public developer preview of Local Voice for Mac: hold Option, speak a
command, and release. A slim bar at the top shows the transcript and result.
Actions execute by default, with on-device speech and local inference. No API
key is needed for normal operation.
What works
- Open apps and websites; supported new-chat/document actions and native menus.
- Identify visible browser/native controls to click, focus, type and fill.
- Search the current Chrome site, scroll, choose dropdown options and operate
standard widgets such as checkboxes, switches and radio buttons. - Run short explicit browser sequences with fresh observations between actions.
- Copy current field text and change its case; native execution of these newest
text operations still awaits a live fixture check. - Use OCR and original GoClick vision for constrained visual targeting.
Install
Download local-voice-source-v0.1.0.tar.gz and
local-voice-command-models-2026-09-23.tar.gz below. Follow the
README.
Requires an Apple Silicon Mac, macOS 14+, Swift 6, native Python 3.11 and 3.12,
and a certificate-backed code-signing identity. Setup downloads pinned GoClick
assets (about 1.09 GB) and Python dependencies. Chrome uses an unpacked extension
(version 0.4.5) with one-time site-access setup. macOS permission grants are required.
This is a source release. There is no notarized, drag-and-drop app installer;
the Python runtime is installed separately. The optional runtime-notices archive
contains attribution, not executable dependencies. SHA256SUMS covers all three
archives. If all archives and the checksum file are in one directory, verify with
shasum -a 256 -c SHA256SUMS before installing.
Limits
This is not yet an arbitrary-goal computer agent. Commands require supported
action types and identifiable controls. Ambiguous targets, frames, closed shadow
roots, canvases and unnamed icons remain gaps. Some delivered clicks/searches
cannot yet verify the intended outcome; X has a narrow search-results adapter.
Experimental planners and fine-tuned vision models are excluded.
Only one M1 Pro development Mac has been tested. Clean second-Mac installation,
broader visual checks and end-to-end speech latency remain unverified. Please
report installation issues and exact failing commands without private content.
Release checks
The clean exported source passed 90 Swift tests, 51 packaging/installation tests,
8 notice-tool tests, 22 browser unit tests, 31 disclosure cases, 37 widget cases,
28 existing-text cases and the rich-text editor check. The native-host test
passed 200 simulated roundtrips. Browser checks ran headlessly with disposable
profiles; no personal tabs or microphone were used. These are regression fixtures,
not a claim of universal app/site compatibility.
All 147 selected source files match the archive manifest; re-export is byte-for-byte
identical. Command assets match the pinned model lock and all 266 packaged notice
hashes verify. No runtime/model behavior changed while preparing this release.
Own source is MIT. Command checkpoints are modified Apache-2.0 BERT derivatives;
GoClick and other dependencies retain their upstream terms. Runtime source and
tests are included; the complete experimental training workspace is not.
Next: easier installation, broader natural-language understanding, visual
perception and better verification after actions.