v0.1.9
What's New
max_stream_response_time for time-based stream batching
Producer stream responses can now buffer multiple batches up to a configurable wall-time limit before emitting a continuation token:
app = make_wsgi_app(
server,
max_stream_response_time=2.0, # buffer up to 2 seconds
)Can be combined with max_stream_response_bytes — the response breaks on whichever limit is reached first.
When neither limit is set, each produce cycle still emits one batch per HTTP response for incremental streaming (unchanged default behavior).