Skip to content

llm-shield-proxy 1.6.10

Choose a tag to compare

@ninadphalak ninadphalak released this 05 Oct 05:19
· 14 commits to main since this release
0ff5660

llm-shield-proxy 1.6.10 gives the Kubernetes sidecar the same health probes as the Deployment.

pip install --upgrade llm-shield-proxy

Fix

The injected sidecar reports Ready when it is ready

Before: a pod labelled llm-shield.io/inject: "true" was Ready while the injected proxy was still starting, and the application's first requests to 127.0.0.1:8000 were refused for a few seconds.
After: the injected container carries the Deployment's /readyz and /livez probes, so the pod turns Ready when the proxy answers.

The response-path setting the benchmark's response-split profile needs, ENABLE_RESPONSE_PII_REDACTION, is now documented in .env.example and the deployment guide. It is off by default, as before.