Skip to content

OpenBalancer v1.5.0 — Enterprise AI & API Load Balancer

Latest
Latest

Choose a tag to compare

View all tags
@incontrolplus incontrolplus released this 18 Aug 05:34
· 16 commits to main since this release
v1.5.0
8dca21e

⚡ OpenBalancer v1.5.0

Engineered & Maintained by INCONTROL PLUS ЕООД (https://www.openbalancer.com)
High-Throughput Asynchronous Reverse Proxy & Intelligent Load Balancer for AI Clusters and Critical APIs.

🚀 Quickstart

1. Install via PyPI:

pip install openbalancer
openbalancer demo

2. One-Line Installer (Linux / macOS):

curl -fsSL https://www.openbalancer.com/install.sh | bash

3. Run with Docker (GHCR Multi-Arch):

docker run -d --name openbalancer -p 8088:8088 ghcr.io/incontrolplus/openbalancer:latest

4. Run Standalone Python:

python3 core/openbalancer.py core/config.json

🌟 Key Highlights & Capabilities

  • Asynchronous Non-Blocking Engine: Sub-millisecond latency routing on Python asyncio sockets.
  • Adaptive Routing Algorithms: Weighted Round-Robin, Least-Connections, Consistent IP-Hash, Power-of-Two Random Choices.
  • Prometheus & Dashboard Telemetry: Native /openbalancer/status endpoint with real-time metrics and latency tracking.
  • Zero-Buffer SSE Streaming: Optimized for LLM inference tokens with O(1) memory overhead.
  • 99.9% Uptime B2B SLA Support: Enterprise support and turnkey deployment by INCONTROL PLUS.

📦 Release Assets & Distribution

  • PyPI Package: pip install openbalancer==1.5.0
  • Standalone Tarball Archive: openbalancer-v1.5.0.tar.gz
  • Container Registry: ghcr.io/incontrolplus/openbalancer:v1.5.0
Assets 5
Loading