Omni 0.2.0
What's changed since v0.1.50
- ci: optional explicit-version input for releases (minor/major cuts)
- perf(index): cross-file IMAGE batching in both the full pass and live updates
- perf(vision): bf16-i/o SDPA - 9.9 images/s; custom-kernel project settled by data
- perf: silu-gate fusion, pooled-token gather, host-built audio windows
- perf(index): cross-file batching for live updates; addMM + weight-cast cache in towers
- perf(search): GPU top-C candidate fast path - O(C) host work after the scan
- build: preserve the dev team when auto-regenerating the xcodeproj
- build: regenerate Omni.xcodeproj when project.yml is newer
- perf(store): pageable host vectors - unlinked-scratch mmap in quant mode
- feat(store): 4-bit quantized scan replica with exact rerank, budget-driven
- perf(store): release the old base before rebuilding - halves the rebuild's transient GPU burst
- perf(store): slim resident metadata - canonical strings, lazy snippets
Install
Open the DMG and drag Omni onto Applications. No Gatekeeper prompt - the build is notarized.
Requirements
- Apple Silicon Mac (M1 or later), macOS 14+.
- First launch downloads the on-device search model (~1.9 GB), then runs offline.