Repository navigation
v0.1.0
First release of an LLM gateway with safety and reliability features.
Highlights
- Prompt-injection and PII detection, response caching, and policy enforcement
- Retry with backoff and provider failover
- Per-tenant isolation of quotas and cache, verified under concurrency
Install: pip install the attached wheel.