issues Search Results · repo:vllm-project/aibrix language:Go
Filter by
698 results
(90 ms)698 results
invllm-project/aibrix (press backspace or delete to remove)🚀 Feature Description and Motivation
Stormservice created pod only have role-template-hash, we can not easily distinguish pod revision between outdated and
new ones.
Labels:
...
area/orchestration
Jeffwan
- 1
- Opened 2 hours ago
- #1582
🚀 Feature Description and Motivation
Replicas here indicates the number of RoleSet. However, in pooled mode, only single roleset is there, instead, it s
better to show replicas for each role.
Current ...
area/orchestration
- Opened 3 hours ago
- #1581
🐛 Describe the bug
AIBrix gateway-plugins pod crashes with fatal error: concurrent map writes in prefix cache eviction logic under high
concurrent load.
Steps to Reproduce
Installation aibrix:
Install ...
area/gateway
kind/bug
ZhangHaoQ
- 1
- Opened 21 hours ago
- #1580
🚀 Feature Description and Motivation
Is there detailed process of PD separation request, such as
img width= 1422 height= 786 alt= Image src=
https://github.com/user-attachments/assets/64540ab7-414a-445f-97d5-59345ea71137 ...
ying2025
- 3
- Opened yesterday
- #1576
When working with other controllers (such as Ray), running kubectl get [resource] provides a meaningful status of the
object.
For example, in kube-ray, when creating a RayService, the status is surfaced ...
omerap12
- 3
- Opened 3 days ago
- #1572
🚀 Feature Description and Motivation
The llm-d-inference-sim project is currently used to simulate an inference engine tests. As this project gains new
features, it will become even easier for us to run ...
zhengkezhou1
- 2
- Opened 7 days ago
- #1569
🐛 Describe the bug
SLO feature is not working
Steps to Reproduce
1.Deployed a qwen2.5-7B model using the following YAML configuration:
apiVersion: apps/v1
kind: Deployment
metadata:
name: qwen25-7b-slo ...
wangchuanfang
- 3
- Opened 8 days ago
- #1567
🚀 Feature Description and Motivation
I m proposing multi-metrics-source support of the AIBrix horizontal pod autoscaler. Because this will make autoscale
strategy more comprehensive and flexible, and ...
area/autoscaling
kind/feature
tianzhiqiang3
- Opened 8 days ago
- #1565
Steps to run example request to xDiT
1. Download xDiT
2. Current implementation/Dockerfile needs to be amended for xDiT to run.
Apply the following patch file to Docker file and launching script
git ...
happyandslow
- 4
- Opened 9 days ago
- #1564
I ve recently been looking into aibrix s kvcache event synchronization feature. However, I ve noticed that the
definition of kvcache events in kv_event_handler_zmq doesn t match that of vllm EventPublisher, ...
wwq2333
- 8
- Opened 10 days ago
- #1559
Learn how you can use GitHub Issues to plan and track your work.
Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub IssuesProTip!
Restrict your search to the title by using the in:title qualifier.Learn how you can use GitHub Issues to plan and track your work.
Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub IssuesProTip!
Restrict your search to the title by using the in:title qualifier.