10 Pull requests merged by 8 people

• [Bug] fix: error when parse complex content in completion body

  #1160 merged Jun 6, 2025

• fix: gateway benchmark info

  #1180 merged Jun 5, 2025

• [Docs] Add vllm-cpu local deployment guide to Quickstart

  #1172 merged Jun 5, 2025

• [Misc]: add unit test for aibrix metrics collector

  #1153 merged Jun 5, 2025

• Enhance the CRD existence check

  #1170 merged Jun 4, 2025

• [Bug]: Fix legacy misconfigurations of autoscaling annotations.

  #1173 merged Jun 3, 2025

• [Bug]: fix(aibrix kvcache): ObjectPool

  #1162 merged Jun 3, 2025

• [Bug] Fix image replacements in Kustomize files to support installation

  #1165 merged Jun 2, 2025

• feat: simplfy router interface

  #1163 merged Jun 2, 2025

• Add unit test code coverage

  #1156 merged Jun 1, 2025

6 Pull requests opened by 6 people

• Add race condition check in unit-test CI and add test-coverage cmd in Makefile

  #1169 opened Jun 2, 2025

• [Refactor] New memory layout for AIBrix KVCache

  #1174 opened Jun 4, 2025

• Add autoscaling strategy Invalid conditions

  #1177 opened Jun 4, 2025

• feat: add support for lora affinity routing strategy

  #1181 opened Jun 5, 2025

• Supporting Mooncake Traces in Workload Generator

  #1182 opened Jun 5, 2025

• [Bug] fix: separate CRDs from application manifests

  #1184 opened Jun 7, 2025

6 Issues closed by 4 people

• Document for mocked cpu app within quickstart page

  #785 closed Jun 5, 2025

• Vllm support extraConfig argument

  #1166 closed Jun 3, 2025

• Optimizer-based autoscaler is slow to scale down

  #1159 closed Jun 3, 2025

• CI failed to upload images

  #1168 closed Jun 2, 2025

• Enhance Kustomize Files to Support Image Mirroring in Restricted Environments

  #1164 closed Jun 2, 2025

• Failed to run benchmark scripts against the endpoint

  #783 closed Jun 2, 2025

7 Issues opened by 5 people

• [rayclusterfleet]rayclusterfleet update but the rayclusterreplicaset is not deleted.

  #1183 opened Jun 6, 2025

• [Code] Remove excessive logs when "model.aibrix.ai/port" is not available by default and improve efficiency

  #1179 opened Jun 4, 2025

• Performance differences between random and prefix-cache-preble routing strategy

  #1178 opened Jun 4, 2025

• Default timeout for gateway

  #1176 opened Jun 4, 2025

• [httproute] add /v1/version is not found

  #1175 opened Jun 4, 2025

• [KVCache] The AIBRIX_KV_CHE-OL_INFINISTORE_VISIBLE_deV_LIST setting is not taking effect

  #1171 opened Jun 3, 2025

• Upgrade from v0.2.1 to v0.3.0 – What is the preferred way?

  #1167 opened Jun 2, 2025

13 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• feat: support prisdb kvcache data plane metrics

  #1158 commented on Jun 3, 2025 • 3 new comments

• Questions about deployment verification：{"error":{"code":500,"message":"invalid character 'u' looking for beginning of value"}}

  #1070 commented on Jun 2, 2025 • 0 new comments

• prefix-cache-preble occur concurrent map read/write panic

  #1131 commented on Jun 2, 2025 • 0 new comments

• [RFC]: Add Support for Prefill/Decode (P/D) Disaggregation in AIBrix

  #1134 commented on Jun 2, 2025 • 0 new comments

• deployment of l1 kv cache using YAML has failed

  #1154 commented on Jun 3, 2025 • 0 new comments

• kvcache cluster cannot start

  #1144 commented on Jun 3, 2025 • 0 new comments

• Isn't multi-node inference a type of high availability mode?

  #1157 commented on Jun 4, 2025 • 0 new comments

• v0.4.0 roadmap

  #1098 commented on Jun 4, 2025 • 0 new comments

• upstream connect error or disconnect/reset before headers

  #1103 commented on Jun 4, 2025 • 0 new comments

• Adding callback patterns for generator client

  #993 commented on Jun 2, 2025 • 0 new comments

• [FIX]: router constructor config init, add gw-plugin metrics server, simplify & enable vtc e2e test

  #1112 commented on Jun 7, 2025 • 0 new comments

• Support content array in completions

  #1152 commented on Jun 6, 2025 • 0 new comments

• [Docs]: update model deployment with dedicated namespace

  #1155 commented on Jun 1, 2025 • 0 new comments