A powerful voice-augmented AI assistant for developers and researchers, built for UCBerkeleyHackathon2025.
SAGE AI helps users converse and brainstorm on the content they browse online. It combines real-time web summarization, semantic memory, and natural voice interaction.
We set out to build an interactive tool that developers and researchers can use to talk with their own web browsing history—to reflect, analyze, or brainstorm using AI.
SAGE AI is powered by:
- Vapi for real-time voice interaction
- Gemini API for smart summarization
- Pinecone for semantic vector storage and retrieval
- Google Cloud Storage (GCS) for scalable backend data handling
- 🧠 Chrome Extension — Capture and summarize webpage content with one click
- 🔎 AI Summarization — Generate concise, meaningful summaries via Gemini API
- 🧭 Semantic Memory — Embed summaries into Pinecone for context-aware search
- 🎤 Voice Assistant — Interact with your saved context via voice, powered by Vapi
- 🔗 API Integration — Send summaries to external APIs or download as
.txtfiles
- Navigate to
chrome://extensions/and enable Developer mode - Click Load unpacked and select the
dom-extensionfolder - Click the extension icon to extract and summarize content from any webpage
- Install dependencies:
pip install fastapi uvicorn pinecone-client- Set API keys:
export PINECONE_API_KEY=your_pinecone_key
export GEMINI_API_KEY=your_gemini_key- Run the backend server:
uvicorn main:app --reload- Available API Endpoints:
POST /vectorize— Store a summary as a vectorPOST /search— Search for semantically similar summaries
- The Chrome extension or web app integrates with Vapi for conversational interaction
- See
popup.jsor your frontend code for integration details
Vectorize a summary:
curl -X POST http://localhost:8000/vectorize -H "Content-Type: application/json" -d '{"text": "Your summary text here"}'Semantic search:
curl -X POST http://localhost:8000/search -H "Content-Type: application/json" -d '{"query": "What are the benefits of apples?"}'- Download summaries as
.txtfiles or send to external APIs - Voice Assistant toggle available directly in the extension popup
- Easily tweak styles in
style.cssto match your UI theme

