Skip to content

Alayra Nexus v1.0.0

Choose a tag to compare

View all tags
@Kinetic-Ide Kinetic-Ide released this 09 Jul 10:04
v1.0.0
43832ac

First tagged release of Alayra Nexus™ — an open-source AI gateway. Pool your provider keys behind one OpenAI-compatible endpoint with load balancing, failover, circuit breaking, rate limits, guardrails, and cost analytics. Self-host in minutes.

🚀 Quick start

Published multi-arch image (amd64 + arm64):

docker run -d --name alayra-nexus -p 3000:3000 \
  -e DATABASE_URL="postgresql://user:pass@host:5432/nexus" \
  -e REDIS_URL="redis://host:6379" \
  -e MASTER_ENCRYPTION_KEY="$(openssl rand -hex 32)" \
  -e ADMIN_PASSWORD="change-me" \
  ghcr.io/alayra-systems-pvt-limited/alayra-nexus:1.0.0

Or run docker compose up -d from a clone (brings its own Postgres + Redis). Dashboard at http://localhost:3000/dashboard.

✨ Highlights

  • OpenAI-compatible proxy with full streaming — one model name, alayra-nexus-1, routed across your pool.
  • Real admission control — atomic per-key RPM/TPM (Redis Lua), a real tokenizer, TPM reservation + reconciliation, upstream timeouts.
  • Circuit breaker — escalating cooldown, half-open recovery probe, separate 429 handling, auto-ban on repeated auth failures.
  • Cache-aware sticky routing — multi-turn conversations reuse the provider's prompt cache.
  • Cost-aware routing (optional) — cheapest healthy, in-headroom provider as a tiebreaker that never overrides health or cache affinity.
  • Content guardrails (optional) — pluggable PII redaction / content + injection blocking.
  • SSRF protection — private/internal hosts blocked by default, with an opt-in allowlist.
  • Async analytics pipeline — usage batched off the request path.
  • Admin dashboard — provider pools, model registry, team keys, analytics, and settings.

🔒 Notes

  • Licensed under Apache-2.0; secrets encrypted at rest (AES-256-GCM); SSRF blocking on by default.
  • Roadmap: constant-time admin-auth comparison and 2FA (Phase 6) are not yet in place — protect your admin password and API key accordingly.

Full changelog: https://github.com/Alayra-Systems-Pvt-Limited/Alayra-Nexus/blob/main/CHANGELOG.md

Assets 2
Loading