Skip to content

v0.2.0 — Server-Sent Events (SSE) Streaming Token Replayer

Choose a tag to compare

View all tags
@aakash1552005 aakash1552005 released this 14 Oct 10:48
· 30 commits to main since this release
v0.2.0
b33a565

🚀 What's New in v0.2.0

🌊 Server-Sent Events (SSE) Streaming Token Replayer (#13)

Deterministic recording and offline replay for streaming LLM responses:

  • Automatic Stream Detection: Detects content-type: text/event-stream responses automatically.
  • Chunk-by-Chunk Replay: Records sequential streaming chunks into cassettes and replays them through custom synchronous and asynchronous byte streams without repeat network calls.
  • Full Async & Sync Support: Works seamlessly in both CassetteTransport and AsyncCassetteTransport.
  • OpenAI Python SDK Integration: Offline support for client.chat.completions.create(..., stream=True) with 0 outbound calls and $0 token cost during replay.
  • Configurable Replay Latency: Optional chunk_delay_ms parameter on transports to simulate realistic token generation latency in UI and integration tests.

👥 Contributors

Special thanks to @abhandary14 for contributing PR #14! 👏

📦 Installation

pip install --upgrade rerunner

Contributors

abhandary14
Assets 2
Loading