Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement weighted round robin load balancing #45

Closed
roma-glushko opened this issue Dec 26, 2023 · 0 comments · Fixed by #75
Closed

Implement weighted round robin load balancing #45

roma-glushko opened this issue Dec 26, 2023 · 0 comments · Fixed by #75

Comments

@roma-glushko
Copy link
Member

No description provided.

@roma-glushko roma-glushko self-assigned this Jan 7, 2024
roma-glushko added a commit that referenced this issue Jan 14, 2024
@roma-glushko roma-glushko linked a pull request Jan 14, 2024 that will close this issue
roma-glushko added a commit that referenced this issue Jan 14, 2024
roma-glushko added a commit that referenced this issue Jan 14, 2024
* #45: Added weight field and WRR routing strategy

* #45: Covered the distribution by tests

* #45 Updated the openAPI specs

* #45 linting
roma-glushko added a commit that referenced this issue Jan 21, 2024
- ✨ [providers] Support for OpenAI Chat API #3 (@mkrueger12 )
- ✨ [API] #54 Unified Chat API  (@mkrueger12 )
- ✨ [providers] Support for Cohere Chat API #5 (@mkrueger12 )
- ✨ [providers] Support for Azure OpenAI Chat API #4  (@mkrueger12 )
- ✨ [providers] Support for OctoML Chat API #58 (@mkrueger12 )
- ✨ [routing] The Routing Mechanism, Adaptive Health Tracking, and Fallbacks #42 #43 #51 (@roma-glushko)
- ✨ [routing] Support for round robin routing strategy #44 (@roma-glushko)
- ✨ [routing] Support for the least latency routing strategy #46 (@roma-glushko)
- ✨ [routing] Support for weighted round robin routing strategy #45 (@roma-glushko)
- ✨ [providers] Support for Anthropic Chat API #60 (@mkrueger12 )
- ✨ [docs] OpenAPI specifications #22 (@roma-glushko )
- 🔧 [chores] Inited the project #6 (@roma-glushko)
- 🔊 [telemetry] Inited logging  #14 (@roma-glushko)
- 🔧 [chores] Inited Glide's CLI #12 (@roma-glushko)
- 👷 [chores] Setup CI workflows #8 (@roma-glushko)
- ⚙️ [config] Inited configs #11 (@roma-glushko)
-  🔧 [chores] Automatic coverage reports #39 (@roma-glushko)
- 👷 [build] Setup release workflows #9 (@roma-glushko)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant