Roadmap

Roadmap

---

Phase 1 — First contact (current)

• Pi capture loop → CodeProject.AI detection + recognition
• ao_reach sidecar with identity-mapped sessions
• Attention state machine (Ambient → Noticed → Engaged)
• openWakeWord hey comstar model trained and tuned
• STT → orchestration → TTS round trip
• Avatar rendering (SVG shipping; TalkingHead lip-sync planned)
• Success criterion: walk up, get greeted by name, ask a question, get a spoken answer in under 15s

Detailed build order: Milestones · live status: Progress Tracker.

---

Phase 2 — Presence

• Custom COMSTAR avatar (rigged for the chosen render path)
• Sentiment → gesture and expression mapping
• Full-duplex barge-in with AEC
• Multi-user greetings and per-person context
• House-wide presence via existing camera events (MQTT / Home Assistant)

---

Phase 3 — Distribution

• Additional Pi terminals in other rooms
• Session handoff between terminals as you move
• Shared KB across all endpoints

---

Phase 4 — Integration

• Home automation actions
• Morning briefing (calendar, weather, news — batch, not conversational)
• Email and Slack triage
• Repo and CI monitoring

---

Explicitly deferred from Phase 1 plan

Custom rigged avatar · full-duplex AEC · sentiment→gesture · multi-user simultaneous presence · house-wide presence · session handoff · morning briefing · email/Slack triage.

These go in backlog — not the M0–M9 sprint. Each is tempting; each slows First Contact.

---

Related pages

• Implementation Plan
• Milestones
• Progress Tracker
• What is COMSTAR