Hands-free desktop controller for four embedded Codex or Claude Code terminal sessions.
npm install
npm run devThe app starts four owned PTY terminals. By default they run codex, claude, codex, and claude from the launch directory. Open Settings to change labels, commands, working directories, the local dictation model, and gesture thresholds.
Speech transcription runs locally with an open-source Transformers.js ASR model. The default is onnx-community/whisper-tiny.en; the first run downloads the model files from Hugging Face.
- Click a terminal to focus it and type normally.
- Use Dictation mode for hands-free speech, or Typing mode to keep head-pointer terminal switching while using the keyboard.
- Click Calibrate, then point your head at each highlighted terminal while it automatically collects samples.
- After calibration, the head pointer dot selects whichever terminal section it is inside.
- Raise an open hand to lock the currently selected terminal until the hand drops.
- In Dictation mode, the open-hand lock starts recording and shows a live transcript overlay as local dictation results come back.
- Hold a fist for about two seconds to send the current transcript to the locked terminal.
- Type into the transcript box and click Send for a manual fallback.
npm run build
npm run package:mac