Skip to content

v0.1.0

Latest

Choose a tag to compare

@ykocaman ykocaman released this 29 Jul 00:14

First release of ILTER — a self-hosted AI gateway shipped as a single Go binary.

Highlights

  • 🧩 MCP Gateway & Marketplace: Connect AI to your APIs, CRM, or MCP servers — zero changes required.
  • Smart Router: Every request is scored for complexity in real time and routed to the right model tier.
  • 🌐 Smart Fallback: Provider down or rate-limited? ILTER fails over to another key or provider, no changes.
  • 💰 Budget Control: Hard daily/monthly spending limits per key — traffic cuts off the instant a limit is hit.
  • 🪪 PII Guard: Emails, SSNs, and other sensitive data are masked before they ever leave your network.
  • 🧠 Semantic Cache: Queries are served from cache — vector search with SHA-256 exact-match fallback.
  • 🛡️ Prompt Guardrails: Blocks injection, toxic content, and off-topic requests before they reach the model.
  • 🌀 Agent Loop Detector: Catches loops by rate, fingerprint, cost, or depth before burning budget.
  • ⏱️ Cron Engine: Schedule recurring AI workflows with standard cron expressions — no external queue needed.
  • 📡 Observability: Prometheus metrics and OpenTelemetry tracing, ready for Grafana, Datadog, or Honeycomb.

Install

Download the binary for your platform below, then:

Linux

chmod +x ilter-v0.1.0-linux-amd64      # or ilter-v0.1.0-linux-arm64 on ARM
./ilter-v0.1.0-linux-amd64 init
./ilter-v0.1.0-linux-amd64 serve

macOS

chmod +x ilter-v0.1.0-darwin-arm64     # or ilter-v0.1.0-darwin-amd64 on Intel
xattr -d com.apple.quarantine ilter-v0.1.0-darwin-arm64   # unsigned binary — Gatekeeper blocks it otherwise
./ilter-v0.1.0-darwin-arm64 init
./ilter-v0.1.0-darwin-arm64 serve

Windows

.\ilter-v0.1.0-windows-amd64.exe init
.\ilter-v0.1.0-windows-amd64.exe serve

If SmartScreen blocks it: click "More info" → "Run anyway" (unsigned binary).

Verify checksums with `checksums.txt` (SHA-256).

See README for full documentation.