Skip to content

v0.1.6

Choose a tag to compare

@bo-unitysvc bo-unitysvc released this 13 May 06:13
· 22 commits to main since this release
c338158

Highlights

Streaming dispatch (#14)

  • New Services.stream() / Groups.stream() (and async siblings) return a context-managed StreamingResponse so callers can lazily iterate LLM SSE / NDJSON / chunked bodies instead of buffering the whole response.
  • iter_events() discriminates on Content-Type (sse / ndjson / line / bytes) and yields a done sentinel on the SSE data: [DONE] convention. SSE frames split across TCP chunks are reassembled at the parser layer.
  • Same auth, interface resolution, and URL composition as the existing dispatch() path.

Request-log storage mode (#15)

  • RequestLogs.start() (and async sibling) now accepts truncate_long_message: bool | None = None.
    • True → truncated (8 KB inline preview, no S3).
    • False → complete (full body uploaded to S3, retrievable via the detail endpoint).
    • None (default) → preserve the user's existing preference.logging mode; fall back to truncated.
  • SDK regenerated from the complete-logging-impl spec.

Install

pip install unitysvc-py==0.1.6