Repository navigation
LLM on Web
Run AI models directly in your browser - no server required!
Version 0.1.1
A Progressive Web App featuring a chat interface with RAG (Retrieval Augmented Generation) capabilities for document-based Q&A.
What's Changed
New Contributors
Full Changelog: v0.1.0...v0.1.1
🚀 Features
- 100% Browser-Based: All processing happens locally in your browser
- Privacy-First: Your data never leaves your device
- RAG Support: Upload documents for context-aware responses
- WebGPU Acceleration: Fast inference with WebGPU, falls back to WASM
- Text-to-Speech: High-quality speech synthesis with streaming support (Kokoro-82M)
- Offline Capable: Works offline once models are cached
- PWA: Install as a native app on any platform
- Multiple File Formats: Supports TXT, MD, PDF, HTML, JSON, and code files
- Document Management: View, delete individual documents or clear all at once
- System Status: Click status indicator to view models, parameters, and document stats
- JetBrains Mono Font: Clean monospace typography throughout the interface