fix(proxy): stream inference responses instead of buffering entire body#261

Merged

johntmyers merged 3 commits intomainfrom

260-fix-inference-streaming-buffering

Mar 12, 2026

Commits on Mar 12, 2026

fix(proxy): stream inference responses instead of buffering entire body
johntmyers
committed
docs: update architecture docs and example for inference streaming
johntmyers
committed
test(example): add direct NVIDIA endpoint tests via L7 TLS intercept
johntmyers
committed