Skip to content

Omni 0.2.0

Choose a tag to compare

@github-actions github-actions released this 11 Jun 20:19

What's changed since v0.1.50

  • ci: optional explicit-version input for releases (minor/major cuts)
  • perf(index): cross-file IMAGE batching in both the full pass and live updates
  • perf(vision): bf16-i/o SDPA - 9.9 images/s; custom-kernel project settled by data
  • perf: silu-gate fusion, pooled-token gather, host-built audio windows
  • perf(index): cross-file batching for live updates; addMM + weight-cast cache in towers
  • perf(search): GPU top-C candidate fast path - O(C) host work after the scan
  • build: preserve the dev team when auto-regenerating the xcodeproj
  • build: regenerate Omni.xcodeproj when project.yml is newer
  • perf(store): pageable host vectors - unlinked-scratch mmap in quant mode
  • feat(store): 4-bit quantized scan replica with exact rerank, budget-driven
  • perf(store): release the old base before rebuilding - halves the rebuild's transient GPU burst
  • perf(store): slim resident metadata - canonical strings, lazy snippets

Install

Open the DMG and drag Omni onto Applications. No Gatekeeper prompt - the build is notarized.

Requirements

  • Apple Silicon Mac (M1 or later), macOS 14+.
  • First launch downloads the on-device search model (~1.9 GB), then runs offline.