Privacy Router routes inference and tool requests based on sensitivity, policy, and operator preference. It should allow OpenShell to direct traffic to frontier models, local NIM/vLLM deployments, or other providers depending on whether the request contains sensitive data, PII, regulated content, or organization-specific constraints.
The goal is operator-controlled inference routing: sensitive requests can stay local, approved requests can use external providers, and routing decisions are visible, auditable, and policy-aware.
Privacy Router routes inference and tool requests based on sensitivity, policy, and operator preference. It should allow OpenShell to direct traffic to frontier models, local NIM/vLLM deployments, or other providers depending on whether the request contains sensitive data, PII, regulated content, or organization-specific constraints.
The goal is operator-controlled inference routing: sensitive requests can stay local, approved requests can use external providers, and routing decisions are visible, auditable, and policy-aware.