Skip to content

v3.0.0

Choose a tag to compare

View all tags
@vitobotta vitobotta released this 09 Aug 19:45
· 8 commits to main since this release
v3.0.0
03a9107
This commit was signed with the committer’s verified signature.
vitobotta Vito Botta
SSH Key Fingerprint: oqZo4eeV8g4e3/IyYnQkP6z7EUUz1pjjJU3eBsQemgA
Verified
Learn about vigilant mode.

⚠️ Breaking changes

  • Set "stream": true on completion requests that require server-sent events. The /v1/chat/completions and /v1/completions endpoints now return one complete JSON response when stream is omitted. Explicit stream: false requests remain non-streaming.

What's New

  • Completion streaming is now opt-in, matching the default request behaviour expected by OpenAI-compatible clients.
  • The README and contributor documentation now describe both response modes and the explicit streaming opt-in.

Tests

  • Route coverage verifies omitted, false, and true stream values.
  • Docker integration checks verify both complete JSON responses and server-sent event streams.
Assets 2
Loading