-
Notifications
You must be signed in to change notification settings - Fork 1
Contracts Bridge Audio
Zlatko Lakisic edited this page Aug 3, 2026
·
1 revision
Transport: ws://127.0.0.1:8778
Envelope: same as Bridge ↔ Kiosk
Status: SPEC

| type | data | meaning |
|---|---|---|
wake |
{score, model} |
Wake word fired above threshold. |
vad.speech_start |
{} |
Speech onset detected. |
vad.speech_end |
{durationMs} |
vad_silence_ms of silence elapsed. |
audio.begin |
{turn_id, sampleRate, encoding} |
Precedes the binary stream. |
audio.chunk |
binary frame | 16 kHz mono PCM s16le, ~320 ms per frame. |
audio.end |
{frames, totalMs} |
Stream complete. |
level |
{rms} |
~10 Hz mic level for the UI meter. |
error |
{code, message} |
Device lost, model load failure. |
| type | data | meaning |
|---|---|---|
listen.start |
{turn_id, maxMs} |
Begin streaming captured audio. |
listen.stop |
{} |
Stop capture (timeout, cancel, barge-in). |
wake.enable |
{enabled} |
Disabled during playback in half-duplex mode. |
play |
{audioUrl, turn_id} |
Unused in Phase 1 — reserved; kiosk is the sink (ADR 0001). |
mute |
{muted} |
Software mute. Reflected in mic_status MCP tool. |
- Rolling in-memory ring buffer (~3 s) — never written to disk by default.
- Include ~500 ms of pre-roll before the wake word in the captured utterance.
- Hard stop at
max_utterance_seconds. - STT is batch after VAD end, not streaming into the model mid-utterance (product path).
Live accuracy path:
mic → comstar-audio (VAD) → bridge PCM → Reach SpeechClient or HttpSttClient → transcript

COMSTAR AI — Not a mystical AI. A tool you engineered — transparent, hackable, fast.
Home · Architecture · Admin Console · Runbook · Contracts
Apache-2.0 · Pre-alpha · Raspberry Pi 4 terminal + local AI server
COMSTAR AI
Start here
Product
Build & configure
Interfaces
- Contracts Overview
- Bridge ↔ Kiosk
- Bridge ↔ Audio
- CodeProject.AI
- AO Reach
- MCP Tools
- Attention State Machine
Features
- Speech (STT/TTS)
- Vision & Face Enrollment
- Directory Identity
- Wake Word
- MCP Topology
- Terminal Control
- Google Workspace
Decisions (ADRs)
- ADR Index
- 0001 Audio Routing
- 0002 Render Path
- 0003 Speech on Ada
- 0004 Terminal Control
- 0005 LDAP Identity
- 0006 House Presence
- 0007 Full-Duplex AEC
- 0008 TTS Engine
- 0009 Proactivity
- 0010 Text Channel
- 0011 Road VPN
- 0012 Admin Network
- 0013 AO mTLS
- 0014 Fallback Hotspot
Operate
Plan
Meta