Skip to content

axel-slid/agentstration

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Agentstration

Agentstration demo

Hands-free desktop controller for four embedded Codex or Claude Code terminal sessions.

Run

npm install
npm run dev

The app starts four owned PTY terminals. By default they run codex, claude, codex, and claude from the launch directory. Open Settings to change labels, commands, working directories, the local dictation model, and gesture thresholds.

Speech transcription runs locally with an open-source Transformers.js ASR model. The default is onnx-community/whisper-tiny.en; the first run downloads the model files from Hugging Face.

Controls

  • Click a terminal to focus it and type normally.
  • Use Dictation mode for hands-free speech, or Typing mode to keep head-pointer terminal switching while using the keyboard.
  • Click Calibrate, then point your head at each highlighted terminal while it automatically collects samples.
  • After calibration, the head pointer dot selects whichever terminal section it is inside.
  • Raise an open hand to lock the currently selected terminal until the hand drops.
  • In Dictation mode, the open-hand lock starts recording and shows a live transcript overlay as local dictation results come back.
  • Hold a fist for about two seconds to send the current transcript to the locked terminal.
  • Type into the transcript box and click Send for a manual fallback.

Build

npm run build
npm run package:mac

About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors