Skip to content

v0.1.9

Choose a tag to compare

@rustyconover rustyconover released this 03 Mar 05:52
· 509 commits to main since this release

What's New

max_stream_response_time for time-based stream batching

Producer stream responses can now buffer multiple batches up to a configurable wall-time limit before emitting a continuation token:

app = make_wsgi_app(
    server,
    max_stream_response_time=2.0,  # buffer up to 2 seconds
)

Can be combined with max_stream_response_bytes — the response breaks on whichever limit is reached first.

When neither limit is set, each produce cycle still emits one batch per HTTP response for incremental streaming (unchanged default behavior).