First release of ILTER — a self-hosted AI gateway shipped as a single Go binary.
Highlights
- 🧩 MCP Gateway & Marketplace: Connect AI to your APIs, CRM, or MCP servers — zero changes required.
- ⚡ Smart Router: Every request is scored for complexity in real time and routed to the right model tier.
- 🌐 Smart Fallback: Provider down or rate-limited? ILTER fails over to another key or provider, no changes.
- 💰 Budget Control: Hard daily/monthly spending limits per key — traffic cuts off the instant a limit is hit.
- 🪪 PII Guard: Emails, SSNs, and other sensitive data are masked before they ever leave your network.
- 🧠 Semantic Cache: Queries are served from cache — vector search with SHA-256 exact-match fallback.
- 🛡️ Prompt Guardrails: Blocks injection, toxic content, and off-topic requests before they reach the model.
- 🌀 Agent Loop Detector: Catches loops by rate, fingerprint, cost, or depth before burning budget.
- ⏱️ Cron Engine: Schedule recurring AI workflows with standard cron expressions — no external queue needed.
- 📡 Observability: Prometheus metrics and OpenTelemetry tracing, ready for Grafana, Datadog, or Honeycomb.
Install
Download the binary for your platform below, then:
Linux
chmod +x ilter-v0.1.0-linux-amd64 # or ilter-v0.1.0-linux-arm64 on ARM
./ilter-v0.1.0-linux-amd64 init
./ilter-v0.1.0-linux-amd64 servemacOS
chmod +x ilter-v0.1.0-darwin-arm64 # or ilter-v0.1.0-darwin-amd64 on Intel
xattr -d com.apple.quarantine ilter-v0.1.0-darwin-arm64 # unsigned binary — Gatekeeper blocks it otherwise
./ilter-v0.1.0-darwin-arm64 init
./ilter-v0.1.0-darwin-arm64 serveWindows
.\ilter-v0.1.0-windows-amd64.exe init
.\ilter-v0.1.0-windows-amd64.exe serveIf SmartScreen blocks it: click "More info" → "Run anyway" (unsigned binary).
Verify checksums with `checksums.txt` (SHA-256).
See README for full documentation.