Skip to content

v0.1.4

Choose a tag to compare

@github-actions github-actions released this 08 Apr 19:53
· 42 commits to main since this release
07bc3df

CHANGELOG

CHANGE: Removed specificity in docs and implementation tying local instances to Ollama; we really support any local OpenAI-compatible inference. Works with Ollama, llama-server, vLLM, SGLang, or anything that exposes /v1/chat/completions.

FIX: Improved ziti context handling to eliminate an issue with leaks on long-running instances. (#7)