High-performance streaming AI gateway featuring dual-transport SSE/WebSockets, Redis semantic caching, dynamic context injection, and automated PII redaction.
python docker redis websocket grafana prometheus server-sent-events fastapi pii-redaction llm sematic-cache
-
Updated
Jun 17, 2026 - Python