Repository navigation
v0.8.0
Knowledge Library and Memory
- Keep a persistent Knowledge Library, organize documents into collections, and let collections watch local folders for changes.
- Search attached documents, selected collections, or the whole library. Hybrid retrieval combines keyword and semantic search when the encoder is available; verified citations open the supporting source text.
- Read more document formats, including HTML and source code, with improved PDF fallback and section-aware chunking. Semantic indexing includes CUDA and Apple Silicon Metal paths where available.
- Enable Memory to keep facts and preferences across chats. Memory is off by default, every suggestion requires approval, and saved facts can be edited or forgotten. Failed storage writes now leave both the saved facts and the on/off switch unchanged and show an error.
Chat, inference, and reliability
- Reuse supported CUDA conversation caches and respond to cancellation during prompt processing as well as generation.
- Add opt-in GPU min-p sampling with guarded CPU fallback, seeded replay, and KV-history regression checks. Existing model-support boundaries remain unchanged.
- Improve exact document excerpts, reply-variant continuations, desktop storage coordination, and bounded engine diagnostics.
- Restore native generation-rate display for the experimental Gemma multi-pass path without labeling native measurements as browser measurements.
- Update frontend and Rust dependencies to resolve the current npm audit findings and eight RustSec vulnerabilities, including TLS and HTTP/2 fixes.
Validation
Release QA covered the frontend build and browser/contract suites; Rust unit and integration tests; a live Windows/NVIDIA server with library persistence, repeated Llama 3.2 1B Q8_0 chat, streaming completion, cancellation, and recovery; and full-model CUDA min-p checks across contiguous, paged, and CPU-prefix routes. These checks do not expand model-support or performance claims beyond the project's existing exact model and backend evidence.
Cross-platform CI and the full release workflow passed. All five package checksums and all 11 asset digests were verified after download. The Windows server and desktop engine passed additional local startup checks, and the Windows executables and installer have valid signatures.
Full Changelog: v0.7.8...v0.8.0