Claudy is an open-source holographic AI companion powered by Claude (Anthropic).
She has a face, a voice, moods, eye animations, and a Jarvis-style HUD — running entirely in your browser.
| Feature | Description |
|---|---|
| 🎭 Holographic Avatar | Gemini-generated AI face with game-style HUD |
| 😊 Mood System | 4 moods — Idle, Happy, Thinking, Angry |
| 👁️ Eye Animation | Pixel-accurate pupil movement, blinking, eye shine via RAF |
| 🌬️ Natural Movement | Breathing, head sway, all smooth via requestAnimationFrame |
| 🎙️ Voice Input | Web Speech API mic (en-IN — Indian English) |
| 🔊 Voice Output | Browser TTS — speaks every response aloud |
| 📷 Camera Feed | Live webcam alongside Claudy — video call style |
| 🧠 Claude Powered | Full Claude API integration (claude-sonnet-4-20250514) |
| 🖥️ HUD Diagnostics | CPU, Memory, Latency, Signal — mood-driven data |
| 🕐 Live Clock | IST · Bengaluru system time |
- Python 3.x (for local server)
- Google Chrome
- Anthropic API Key
- Download or clone this repo
- Open
build/claudy_v8.htmlin a text editor - Replace
YOUR_API_KEY_HEREwith your Anthropic API key - Put the HTML file in the same folder as
launcher/start_claudy.bat - Double-click
start_claudy.bat - Claudy launches in Chrome! ✅
# Clone the repo
git clone https://github.com/naveenmanwani/claudy.git
cd claudy
# Start local server
python -m http.server 8080
# Open in Chrome
# http://localhost:8080/build/claudy_v8.html
⚠️ Always run via localhost, not by opening the file directly.
Chrome only grants mic/camera trust tolocalhost— not localfile://paths.
Open the HTML file in any text editor and find:
const API_KEY = "YOUR_API_KEY_HERE";Replace with your key from console.anthropic.com:
const API_KEY = "sk-ant-api03-...";🔒 Security note: Never commit your API key to GitHub.
The.gitignoreexcludes any file namedclaudy_v8_with_key.htmlor similar.
Set a spend limit on your Anthropic account for safety.
claudy/
├── build/ # Ready-to-use HTML files
│ └── claudy_v8.html # Stable release
│
├── src/ # React JSX source files
│ ├── claudy_v8.jsx # V8 component source
│ └── claudy_eye_calibrator.jsx # Interactive eye position tool
│
├── assets/ # Static assets
│ └── claudy_avatar.png # Claudy's face image
│
├── launcher/
│ └── start_claudy.bat # Windows one-click launcher
│
├── docs/
│ ├── ARCHITECTURE.md # Technical deep dive
│ ├── EYE_CALIBRATION.md # How eye positions were measured
│ ├── BUILD_LOG.md # Full development journey
│ └── DEMO_PROMPTS.md # Curated prompts to showcase Claudy
│
├── .gitignore
├── LICENSE
└── README.md
- Holographic avatar with pixel-accurate eye animations
- 4 mood states with HUD diagnostics
- Voice input (mic) + voice output (TTS)
- Camera feed — video call style
- All animations via
requestAnimationFrame - Tested and reliable for demos
Not sure what to say to Claudy? We've got you covered.
Check out docs/DEMO_PROMPTS.md for:
- Prompts that trigger each mood state
- A suggested 3-minute demo flow for audiences
- Voice input examples
- India-focused conversation starters
| Layer | Technology |
|---|---|
| UI | React 18 (via CDN + Babel standalone) |
| Animation | requestAnimationFrame |
| Voice Input | Web Speech Recognition API (en-IN) |
| Voice Output | Web Speech Synthesis API |
| Camera | WebRTC getUserMedia |
| AI Brain | Claude API (claude-sonnet-4-20250514) |
| Styling | Inline CSS + SVG overlays |
| Server | Python http.server |
Claudy's eye animations are pixel-accurate — not guessed.
We used Python + Pillow to:
- Load the avatar image (2394×1760px)
- Calculate
objectFit: coverdisplay math - Mark eye centers with colored ellipses
- Convert to fractions of the display circle diameter
- Iterate 3 rounds until markers landed perfectly on her pupils
Final calibrated values (set by Naveen using the calibrator tool):
const EYE = { lx:0.4025, ly:0.4058, rx:0.5948, ry:0.4058, ir:0.058 };See docs/EYE_CALIBRATION.md for full details.
Contributions welcome! Especially:
- Mobile optimization
- New mood states
- Voice input improvements for Indian accents
Please open an issue before submitting a PR.
Naveen Manwani
Product Operations Engineer | AI Builder | Bengaluru 🇮🇳
Apache License 2.0 — see LICENSE for details.
⚠️ Avatar Image Notice: The avatar image (assets/claudy_avatar.png) was generated using Google Gemini. Commercial use of this image may be subject to Google's terms of service.