issues Search Results · repo:vllm-project/aibrix language:"Jupyter Notebook"
Filter by
416 results
(132 ms)416 results
invllm-project/aibrix (press backspace or delete to remove)🚀 Feature Description and Motivation
Currently AIBrix estimates TPM with this formula: RPM * 1000 (source), which is not accurate in common cases and can
lead to over- or under-throttling.
Use Case
...
Stephen-X
- Opened 2 hours ago
- #848
🚀 Feature Description and Motivation
We encounter some stability issues in the past, https://github.com/vllm-project/aibrix/pull/825 was proposed to address
such issues. We should use this opportunity ...
area/installation
kind/enhancement
priority/important-soon
Jeffwan
- Opened 11 hours ago
- #847
Summary
This RFC proposes making the API Gateway interface within AIBrix compatible with OpenAI. We met few issues in the past
few days. and @gaocegege also suggest https://github.com/vllm-project/aibrix/issues/732 ...
area/gateway
kind/enhancement
priority/critical-urgent
- Opened 11 hours ago
- #846
🚀 Feature Description and Motivation
AIBrix, which is composed of multiple controllers, currently lack of comprehensive monitoring makes it difficult to
effectively manage and troubleshoot the system. ...
area/stability
kind/feature
priority/important-longterm
- Opened 11 hours ago
- #845
🚀 Feature Description and Motivation
I received feedback that users are encountering issues where the aibrix-controller-manager cannot list resources of type
mutatingwebhookconfiguration from the master ...
area/installation
kind/documentation
priority/important-soon
- Opened 12 hours ago
- #844
🚀 Feature Description and Motivation
🚀 I m proposing adding support for the SGLang inference engine to AIBrix because it s emerging as one of the community s
most popular inference frameworks. In our ...
Belyenochi
- Opened 21 hours ago
- #843
🚀 Feature Description and Motivation
Do you have any testing suggestions and cases to compare the performance improvement of using Aibrix? At present, we
have tested using VLLM to start and using Raycluster ...
kind/support
triage/needs-information
ying2025
- 4
- Opened yesterday
- #842
🐛 Describe the bug
INFO 03-09 00:16:28 api_server.py:913] args: Namespace(subparser= serve , model_tag= /models/deepseek-r1 , config= , host=None, port=8000, uvicorn_log_level= warning , allow_credentials=False, ...
- 7
- Opened 2 days ago
- #834
🐛 Describe the bug
This is a follow up issue of https://github.com/vllm-project/aibrix/issues/783
Seems some specific prompt data will fail the test
python benchmark_serving.py --backend vllm --model ...
area/benchmark
kind/bug
priority/important-soon
- Opened 2 days ago
- #832
🐛 Describe the bug
Image
Steps to Reproduce
use deepseek-r1-local-volume version
Expected behavior
it should create the pods successfully
Environment
commit: 1f96e9a47aab42cf003ed4bd031701eea754332c24b6b10c691ee5a842eeceb1 ...
- 1
- Opened 3 days ago
- #831
Learn how you can use GitHub Issues to plan and track your work.
Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub IssuesProTip!
Press the /
key to activate the search input again and adjust your query.Learn how you can use GitHub Issues to plan and track your work.
Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub IssuesProTip!
Press the /
key to activate the search input again and adjust your query.