Search results

Can aibrix support multiple inference serving frameworks?such as sglang, tritonserver,etc.

Status: Open.

#1245 In vllm-project/aibrix;

· Miller-Xie opened on Jul 3, 2025

can't find envoy-aibrix-system-aibrix-eg

Status: Open.

#1244 In vllm-project/aibrix;

· akaihaoshuai opened on Jul 3, 2025

When will v0.4.0 be released and support vLLM V1?

kind/supportCategorizes issue as a support question.Categorizes issue as a support question.

Status: Open.

#1242 In vllm-project/aibrix;

· libin817927 opened on Jul 2, 2025

[CODE] Remove the pkg/plugins/gateway/algorithms/util.SelectRandomPodAsFallback and replace with router SetFallback()

kind/cleanupCategorizes issue or PR as related to cleaning up code, process, or technical debt.Categorizes issue or PR as related to cleaning up code, process, or technical debt.

Status: Open.

#1241 In vllm-project/aibrix;

· zhangjyr opened on Jul 1, 2025

Error running llama70b on AIBrix With Distributed KVCache and Cross-Engine KV Reuse

area/distributed

area/kv-cache

Status: Open.

#1240 In vllm-project/aibrix;

· NirLevy98 opened on Jul 1, 2025

failed to start stormservice in standalone mode

Status: Open.

#1238 In vllm-project/aibrix;

· Jeffwan opened on Jul 1, 2025

Prefix-hash implementation in PR #1218 re-computes full prefixes and degrades to O(N²)

kind/enhancementNew feature or requestNew feature or request

priority/critical-urgentHighest priority. Must be actively worked on as someone's top priority right now.Highest priority. Must be actively worked on as someone's top priority right now.

Status: Open.

#1234 In vllm-project/aibrix;

· ae86zhizhi opened on Jun 30, 2025

Switch to Host Override Based Routing instead of static EPP

area/gateway

Status: Open.

#1233 In vllm-project/aibrix;

· Xunzhuo opened on Jun 28, 2025

[Bug] 在 only_rise=true 时，sine_fluctuation 抛出 TypeError（prev_value=None）

area/autoscaling

area/benchmark

Status: Open.

#1232 In vllm-project/aibrix;

· SmallHappyJerry opened on Jun 27, 2025

Refactor the architecture docs in separate sections

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

kind/documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#1231 In vllm-project/aibrix;

· Jeffwan opened on Jun 27, 2025

[Proposal]: Integration With Envoy AI Gateway

area/gateway

kind/enhancementNew feature or requestNew feature or request

priority/important-soonMust be staffed and worked on either currently, or very soon, ideally in time for the next release.Must be staffed and worked on either currently, or very soon, ideally in time for the next release.

Status: Open.

Feature

#1225 In vllm-project/aibrix;

· Xunzhuo opened on Jun 23, 2025

Add Prefill/Decode Disaggregation Support in Inference Gateway

area/disaggregated

area/gateway

priority/important-soonMust be staffed and worked on either currently, or very soon, ideally in time for the next release.Must be staffed and worked on either currently, or very soon, ideally in time for the next release.

Status: Open.

Feature

#1223 In vllm-project/aibrix;

· Xunzhuo opened on Jun 23, 2025