Skip to content

v0.6.2-beta | Native CPU Embedding model support

Choose a tag to compare

View all tags
@voodooEntity voodooEntity released this 03 Oct 13:43
· 13 commits to main since this release
v0.6.2-beta
4a6e1ce
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Release Notes: Local CPU Embeddings & Sandbox Optimization Update

This update introduces local CPU embeddings, optimizes sandbox boot times for Linux hosts, and stabilizes memory extraction pipelines.

Architectural Changes: Local CPU Embeddings

  • Integrated llama-go C++ bindings to support lightning-fast, offline CPU inference for semantic search using GGUF models.
  • Portable Configuration Paths: Settings (such as LocalEmbeddingModelPath) are now stored using a ~/ prefix substitution engine. This guarantees that a shared config.json remains perfectly portable across different users, machines, and the internal Docker sandbox without "path poisoning."
  • Updated the Setup Script to natively prompt for and download compatible GGUF embedding models.

Sandbox & Host Parity

  • Auto-Detect Binary Optimization: The loa-sandbox boot sequence now dynamically inspects the host's loa executable using file and ELF validation. If the host binary is compatible with the Debian container (e.g., Linux users), the sandbox imports the binary and skips compilation entirely for an instant boot.
  • Cross-OS Compatibility: For macOS and Windows users, the sandbox gracefully falls back to syncing source code and compiling the Linux binary inside the container, guaranteeing a working environment regardless of the host OS.
  • Volume Mount Integrity: Fixed volume mounts to properly map the host's .loa directory directly to the container user's logical home, ensuring config.json portability. The host's global configuration is explicitly mounted Read-Only to prevent the sandbox from destructively overriding host settings.

Bug Fixes & Stability

  • Memory Extraction: Fixed a structural bug in the memory extraction pipeline where parsing logic from message history arrays was failing or extracting incomplete contexts.
  • UI Label Rendering: Repaired a CSS/JS rendering bug in the settings modal where configuration labels and dropdowns (specifically the Local Model Path) were displaying squished or hidden under certain viewport constraints.

Default Configuration Adjustments

To better align with modern 32B+ parameter models and deep architectural reasoning capabilities, default parameters have been upgraded:

  • Max Plan Depth increased from 5 to 25.
  • Total Context Budget increased from 16,000 to 100,000.

Fix Github Workflow

  • Fix github release build workflow
Assets 4
Loading