6 Pull requests merged by 6 people

• Supporting Mooncake Traces in Workload Generator

  #1182 merged Jun 11, 2025

• Add race condition check in unit-test CI and add test-coverage cmd in Makefile

  #1169 merged Jun 10, 2025

• [Bug] fix: error when parse complex content in completion body

  #1160 merged Jun 6, 2025

• fix: gateway benchmark info

  #1180 merged Jun 5, 2025

• [Docs] Add vllm-cpu local deployment guide to Quickstart

  #1172 merged Jun 5, 2025

• [Misc]: add unit test for aibrix metrics collector

  #1153 merged Jun 5, 2025

2 Pull requests opened by 2 people

• feat: add support for lora affinity routing strategy

  #1181 opened Jun 5, 2025

• [Bug] fix: separate CRDs from application manifests

  #1184 opened Jun 7, 2025

2 Issues closed by 2 people

• Empty LB_IP when try Quickstart for AMD ROCm Cluster

  #998 closed Jun 11, 2025

• Document for mocked cpu app within quickstart page

  #785 closed Jun 5, 2025

3 Issues opened by 3 people

• Gateway: model doesn't exist in cache for Model Adapters

  #1186 opened Jun 9, 2025

• Balanced strategy question

  #1185 opened Jun 9, 2025

• [rayclusterfleet]rayclusterfleet update but the rayclusterreplicaset is not deleted.

  #1183 opened Jun 6, 2025

12 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Add autoscaling strategy Invalid conditions

  #1177 commented on Jun 11, 2025 • 3 new comments

• [Docs]: update model deployment with dedicated namespace

  #1155 commented on Jun 11, 2025 • 1 new comment

• Default timeout for gateway

  #1176 commented on Jun 6, 2025 • 0 new comments

• Performance differences between random and prefix-cache-preble routing strategy

  #1178 commented on Jun 9, 2025 • 0 new comments

• deployment of l1 kv cache using YAML has failed

  #1154 commented on Jun 9, 2025 • 0 new comments

• [KVCache] The AIBRIX_KV_CHE-OL_INFINISTORE_VISIBLE_deV_LIST setting is not taking effect

  #1171 commented on Jun 10, 2025 • 0 new comments

• customize the kubebuilder cluster file for more granular testing

  #187 commented on Jun 10, 2025 • 0 new comments

• [RFC]: Add Support for Prefill/Decode (P/D) Disaggregation in AIBrix

  #1134 commented on Jun 11, 2025 • 0 new comments

• [httproute] add /v1/version is not found

  #1175 commented on Jun 11, 2025 • 0 new comments

• Adding callback patterns for generator client

  #993 commented on Jun 9, 2025 • 0 new comments

• [FIX]: router constructor config init, add gw-plugin metrics server, simplify & enable vtc e2e test

  #1112 commented on Jun 11, 2025 • 0 new comments

• [Refactor] New memory layout for AIBrix KVCache

  #1174 commented on Jun 5, 2025 • 0 new comments