4 Pull requests merged by 2 people

• Configure gpu-deployment.yaml to force vLLM v1 with LoRA

  #573 merged Mar 25, 2025

• Configure the vllm deployment with best practices for startup

  #550 merged Mar 25, 2025

• Bump sigs.k8s.io/controller-runtime from 0.20.3 to 0.20.4

  #570 merged Mar 25, 2025

• Bump github.com/onsi/gomega from 1.36.2 to 1.36.3

  #569 merged Mar 25, 2025

2 Pull requests opened by 2 people

• Adding printer columns to inference model

  #574 opened Mar 25, 2025

• Docs: Updates getting started guide for kgateway

  #575 opened Mar 25, 2025

1 Issue closed by 1 person

• Handle response body parsing for both streaming and non-streaming cases

  #178 closed Mar 25, 2025

1 Issue opened by 1 person

• Record the limitation that only a single EPP replica has been tested so far

  #572 opened Mar 25, 2025

4 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• We should encourage all InferencePool deployments to gracefully rollout and drain

  #549 commented on Mar 25, 2025 • 0 new comments

• Create env vars for the algorithm's scheduling parameters

  #447 commented on Mar 25, 2025 • 0 new comments

• v0.3.0 Release Tracker

  #493 commented on Mar 25, 2025 • 0 new comments

• Validate model/adapter is available on the model server before sending requests to a model server

  #49 commented on Mar 25, 2025 • 0 new comments