Repository navigation
SAGE v1.0.0 — Initial Android Release
SAGE v1.0.0 — Initial Android Release
SAGE (Smriti Adaptive Guardian Engine) is an end-to-end multimodal wearable memory capture and conversational recall system uniting an ESP32-S3 wearable capture unit, a Flutter + Kotlin Android companion client, Google Gemini multimodal scene understanding, and user-owned Google Drive archival.
What's Included in v1.0.0
- Hardware-Backed API Key Security (Control Agent): Configure your own Google Gemini API key under Control Agent (
You) → AI & Intelligence → Gemini API Key. Keys are encrypted on-device with Android Keystore (AES-256-GCM), persist across restarts, support updates/deletion, and are never bundled into the APK or logged. - Four-Tab Multimodal Experience:
- Memories: Chronological life-log timeline, in-app
media_kitplayback, transcripts, Human Memory narrative, and Reconstruction Blueprint. - Capture: Direct programmatic Wi-Fi pairing (
WifiNetworkSpecifier+bindProcessToNetwork()) toSAGE-XIAO(192.168.4.1), live VGA viewfinder, and streaming RIFF/AVI muxing with post-hoc A/V drift correction. - Recall: Voice (
speech_to_text) & text chat powered by Gemini + Hybrid RAG across video memories, persistent profile/project vaults, and PDF/DOCX/image/code attachments, linking directly to original video evidence. - Control (
You): Google Drive OAuth 2.0 (drive.file+drive.appdata), Uploaded vs. Pending counters, manual sync, and Personal Memory Vault CRUD.
- Memories: Chronological life-log timeline, in-app
Quick Start & Installation
Evaluators without physical hardware: You do not need an ESP32-S3 device to evaluate SAGE. Recall Chat, Persistent Memory Vault, Document/Image Analysis, and Google Drive synchronization work immediately on Android.
- Download
SAGE-v1.0.0-android.apkbelow and install it on Android 8.0+ (Android 10+ recommended for programmatic wearable Wi-Fi pairing). - Open SAGE → You (Control Agent) → Gemini API Key.
- Enter your personal key from Google AI Studio and tap Save & Verify Key.
- (Optional) Connect Google Drive under Storage & Backup for cloud backup and cross-device Memory Vault sync.
Hardware Compatibility (Optional)
- Target Device: Seeed Studio XIAO ESP32-S3 Sense running SAGE Firmware
v3.0.0(SoftAPSAGE-XIAO, HTTP:80video/control, TCP:8116 kHz I2S PDM audio). - See the Hardware Setup Guide.
Known Limitations & Security Notes
- Zero Embedded Secrets: Verified zero
.envor API keys inside the compiled APK (SHA-256: C6A8630137E0116D3E184C07FF46FE2DAB868620168A6EB4FD157D86FD2F6E77). - Pilot Scope & Storage: Current local vault storage uses per-user JSON files (
vault.json) andSharedPreferences; SQLite + dense vector embeddings, on-device bystander face-blurring, and scopednetwork_security_config.xmlare planned for upcoming releases. - Full details: Known Limitations · Privacy & Security
Research Foundation: ByteBastion/SAGE-AI