Skip to content

v0.8.6

Choose a tag to compare

@nvkudva nvkudva released this 26 Oct 21:46
· 39 commits to main since this release

Reliability fixes from a full code review.

  • A worker that is slow to answer now gets a 504 instead of being restarted mid-job.
  • Stop now cancels a retained request while its model downloads or cold-loads.
  • Worker crash logs no longer vanish once a log passes 10 MB.
  • omni down finishes cleanup within 5 s even with a stream open, so pinned Ollama models are released; the gateway access log is off.
  • Inference routes refuse Origin: null (sandboxed iframes on other sites).
  • Decide model files are copied atomically, and deleting the model frees its disk.
  • TTS input with nothing speakable is a 400, not a 500.

Upgrade: brew update && brew upgrade omni, or rerun install.sh. Then omni restart.