Skip to content

MDiopp/Solace.ai

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

12 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

๐Ÿงธ Solace.ai

A real-time, voice-based AI companion designed to provide emotional comfort and gentle companionship to children in hospice care.

๐ŸŽฏ Project Overview

Solace.ai is not just a chatbotโ€”it is a voice-first companion built to feel like a calm, caring presence.

It allows children to:

speak naturally (no buttons required) receive warm, emotionally-aware responses engage in continuous, back-and-forth conversation

The system is designed to feel like:

a plush companion, a bedside friend, a comforting voice that stays with you

๐Ÿ’ก Why This Matters

Children in hospice care often experience isolation, fear, and emotional distress.

Solace.ai provides:

a constant, gentle presence emotionally safe responses a natural interface (voice) that requires no physical effort ๐Ÿง  Core Concept

Traditional systems:

speech โ†’ response

Solace.ai:

continuous, emotionally-aware conversation

Key difference:

prioritizes presence over productivity focuses on comfort, not tasks ๐Ÿ—๏ธ System Architecture ๐Ÿง  Backend (AI Brain)

Built with FastAPI, the backend handles the full real-time voice pipeline:

๐Ÿ” Core Pipeline Wake word detection Voice activity detection (records until silence) Speech-to-text (Whisper) LLM response generation (OpenAI) Text-to-speech (OpenAI TTS) Audio playback Follow-up listening (multi-turn conversation) โš™๏ธ Key Features Multi-turn conversation No wake word required after initial activation Interrupt handling User can speak while AI is talking Emotional safety layer Detects distress signals and adapts responses Conversation memory Maintains recent context for natural dialogue Real-time event streaming WebSocket-based updates to frontend ๐ŸŒ Frontend (Control Dashboard)

Built with React + Vite

Purpose: Start / stop / reset the system Display real-time system state: listening thinking speaking Show: user transcript AI responses live logs

โš ๏ธ Note: The frontend does not perform any AI processing It exists purely for control, visibility, and demo polish

๐Ÿงฉ Design Philosophy Laptop = Brain Runs all AI components for speed and flexibility Frontend = Interface Provides transparency and control (Future) Raspberry Pi + Plush Physical embodiment of the companion Acts as an interaction trigger device ๐Ÿ” Interaction Flow User says wake word System begins listening Speech is recorded and transcribed AI generates a gentle, emotionally-aware response Response is spoken aloud System waits for follow-up Conversation continues naturally ๐Ÿ’ Personality: Rhasspy

Solace.ai features a soft, child-friendly character:

Rhasspy โ€” a kind monkey with a red cape

Design goals:

warm and calming tone gentle storytelling emotionally supportive responses encourages continued conversation ๐Ÿš€ Current Status โœ… Core voice pipeline implemented โœ… Backend fully functional โœ… Frontend integrated and polished โœ… Real-time interaction working โœ… Multi-turn conversation enabled โœ… Demo-ready ๐Ÿ”ฎ Future Improvements ๐Ÿงธ Physical plush integration (Raspberry Pi trigger system) โค๏ธ More advanced emotional detection (tone + sentiment analysis) ๐Ÿฅ Clinical feedback integration (hospice care specialists) ๐ŸŒ Deployment for broader accessibility ๐ŸŽญ Expanded personality behaviors and storytelling depth ๐Ÿ› ๏ธ Tech Stack

Backend

FastAPI OpenAI API (LLM + TTS) Whisper (Speech-to-Text) WebSockets

Frontend

React Vite Tailwind (optional styling layer)

Hardware (Planned)

Raspberry Pi 4 Model B Bluetooth speaker Plush companion enclosure โš ๏ธ Ethical Considerations

This project is designed with emotional safety as a priority.

Responses are constrained to be: non-harmful age-appropriate comforting The system is not a replacement for human care, but a supportive supplement ๐Ÿ“Œ Getting Started (Basic)

Backend

cd backend pip install -r requirements.txt uvicorn main:app --reload

Frontend

cd frontend npm install npm run dev

Then open:

http://localhost:5173 ๐Ÿค Acknowledgements

Built as part of a hackathon project focused on:

human-centered AI accessibility emotional well-being ๐Ÿ“ฌ Contact

For questions, collaboration, or feedback:

GitHub Issues Direct outreach

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors