You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The non-streaming (complete-response) path already supports rewrite via apply_output_guardrail_rewrite.
Goal
Implement support for GuardrailOutcome::Rewrite in the streaming output guardrail path, so that guardrail-driven rewrites can be applied to buffered/replayed stream content.
Summary
When a guardrail returns a
Rewriteoutcome for a streaming response, the proxy currently rejects the request with an error:This is a placeholder until whole-response streaming rewrite is implemented.
Context
apply_stream_output_guardrailsinsrc/proxy/handlers/format_handler.rs.apply_output_guardrail_rewrite.Goal
Implement support for
GuardrailOutcome::Rewritein the streaming output guardrail path, so that guardrail-driven rewrites can be applied to buffered/replayed stream content.References
/cc @bzp2010