Skip to content

OpenBalancer v1.4.2 — Enterprise AI & API Load Balancer

Choose a tag to compare

View all tags
@github-actions github-actions released this 17 Aug 20:08
· 27 commits to main since this release
v1.4.2
d80fdf0

⚡ OpenBalancer v1.4.2

Engineered & Maintained by INCONTROL PLUS ЕООД (https://www.openbalancer.com)
High-Throughput Asynchronous Reverse Proxy & Intelligent Load Balancer for AI Clusters and Critical APIs.

🚀 Quickstart

1. One-Line Installer (Linux / macOS):

curl -fsSL https://www.openbalancer.com/install.sh | bash

2. Run with Docker (GHCR Multi-Arch):

docker run -d --name openbalancer -p 8088:8088 ghcr.io/incontrolplus/openbalancer:latest

3. Run Standalone Python:

python3 core/openbalancer.py core/config.json

🌟 Key Highlights & Capabilities

  • Asynchronous Non-Blocking Engine: Sub-millisecond latency routing on Python asyncio sockets.
  • Adaptive Routing Algorithms: Weighted Round-Robin, Least-Connections, Consistent IP-Hash, Power-of-Two Random Choices.
  • Prometheus & Dashboard Telemetry: Native /openbalancer/status endpoint with real-time metrics and latency tracking.
  • Zero-Buffer SSE Streaming: Optimized for LLM inference tokens with O(1) memory overhead.
  • 99.9% Uptime B2B SLA Support: Enterprise support and turnkey deployment by INCONTROL PLUS.

📦 Release Assets

  • Standalone Tarball Archive: openbalancer-v1.4.2.tar.gz
  • Container Registry: ghcr.io/incontrolplus/openbalancer:v1.4.2
Assets 3
Loading