Skip to content

Conversation

@yuluo-yx
Copy link
Contributor

Signed-off-by: yuluo-yx <yuluo08290126@gmail.com>
Signed-off-by: yuluo-yx <yuluo08290126@gmail.com>
Signed-off-by: yuluo-yx <yuluo08290126@gmail.com>
@netlify
Copy link

netlify bot commented Oct 24, 2025

Deploy Preview for vllm-semantic-router ready!

Name Link
🔨 Latest commit f9e951f
🔍 Latest deploy log https://app.netlify.com/projects/vllm-semantic-router/deploys/6905b6d73bfc9c000897f488
😎 Deploy Preview https://deploy-preview-532--vllm-semantic-router.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@github-actions
Copy link

github-actions bot commented Oct 24, 2025

👥 vLLM Semantic Team Notification

The following members have been identified for the changed files in this PR and have been automatically assigned:

📁 deploy

Owners: @rootfs, @Xunzhuo
Files changed:

  • deploy/helm/README.md
  • deploy/helm/semantic-router/.helmignore
  • deploy/helm/semantic-router/Chart.yaml
  • deploy/helm/semantic-router/README.md
  • deploy/helm/semantic-router/templates/NOTES.txt
  • deploy/helm/semantic-router/templates/_helpers.tpl
  • deploy/helm/semantic-router/templates/configmap.yaml
  • deploy/helm/semantic-router/templates/deployment.yaml
  • deploy/helm/semantic-router/templates/hpa.yaml
  • deploy/helm/semantic-router/templates/ingress.yaml
  • deploy/helm/semantic-router/templates/namespace.yaml
  • deploy/helm/semantic-router/templates/pvc.yaml
  • deploy/helm/semantic-router/templates/service.yaml
  • deploy/helm/semantic-router/templates/serviceaccount.yaml
  • deploy/helm/semantic-router/values-dev.yaml
  • deploy/helm/semantic-router/values-example.yaml
  • deploy/helm/semantic-router/values-prod.yaml
  • deploy/helm/semantic-router/values.yaml
  • deploy/helm/validate-chart.sh

📁 tools

Owners: @yuluo-yx, @rootfs, @Xunzhuo
Files changed:

  • tools/make/helm.mk

📁 Root Directory

Owners: @rootfs, @Xunzhuo
Files changed:

  • Makefile

vLLM

🎉 Thanks for your contributions!

This comment was automatically generated based on the OWNER files in the repository.

@rootfs rootfs requested a review from Copilot October 24, 2025 16:35
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR adds comprehensive Helm chart support for deploying Semantic Router on Kubernetes, providing an alternative to the existing Kustomize deployment method. The implementation includes production and development configurations, validation tooling, and extensive Make target automation.

Key Changes

  • Added complete Helm chart structure with templates for all Kubernetes resources (Deployment, Service, ConfigMap, PVC, Ingress, HPA, etc.)
  • Introduced environment-specific values files (dev, prod, example) with optimized configurations for different deployment scenarios
  • Integrated Helm deployment automation through Make targets and validation scripts

Reviewed Changes

Copilot reviewed 22 out of 22 changed files in this pull request and generated 22 comments.

Show a summary per file
File Description
tools/make/helm.mk Comprehensive Make targets for Helm operations including install, upgrade, testing, and port-forwarding
tools/make/linter.mk Removed documentation linting targets (likely relocated or obsolete)
deploy/helm/semantic-router/Chart.yaml Helm chart metadata and project information
deploy/helm/semantic-router/values.yaml Default configuration values for the Helm deployment
deploy/helm/semantic-router/values-dev.yaml Development environment optimized values
deploy/helm/semantic-router/values-prod.yaml Production environment optimized values with HA setup
deploy/helm/semantic-router/values-example.yaml Example configuration demonstrating customization options
deploy/helm/semantic-router/templates/*.yaml Kubernetes resource templates for deployment infrastructure
deploy/helm/semantic-router/templates/_helpers.tpl Helm template helper functions
deploy/helm/validate-chart.sh Automated validation script for chart testing
deploy/helm/README.md Comprehensive deployment guide with examples
deploy/helm/semantic-router/README.md Detailed chart documentation
Makefile Integration of helm.mk into main build system
Comments suppressed due to low confidence (1)

deploy/helm/semantic-router/values.yaml:1

  • Inconsistent model path format. Line 218 uses 'models/all-MiniLM-L12-v2' (with 'models/' prefix) while line 57 uses 'sentence-transformers/all-MiniLM-L12-v2' (repository format). These should be consistent - line 218 should match the repository format used for downloading.
# Default values for semantic-router.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@yuluo-yx yuluo-yx marked this pull request as draft October 24, 2025 16:55
@yuluo-yx yuluo-yx requested a review from Copilot October 25, 2025 09:44
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

Copilot reviewed 22 out of 22 changed files in this pull request and generated 11 comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@nithin8702
Copy link

Hi @yuluo-yx We would like to use semantic router with nginx ingress. Is that possible with your PR?
#557

@yuluo-yx
Copy link
Contributor Author

yuluo-yx commented Nov 1, 2025

If all goes well, it should be possible to do this. I've been quite busy lately, but I'll test it locally this weekend and prepare for the merge. 👀

when I'm ready to merge, pls review the code if you have time. thx @nithin8702

@nithin8702
Copy link

@yuluo-yx Could you please confirm your PR works with nginx ingress or envoy ai gateway?

Is there a way i can test your helm chart now?

Also there is a chat going on in Slack. Please check
https://vllm-dev.slack.com/archives/C09CTGF8KCN/p1761751362685129

@yuluo-yx
Copy link
Contributor Author

yuluo-yx commented Nov 1, 2025

@yuluo-yx Could you please confirm your PR works with nginx ingress or envoy ai gateway?

Is there a way i can test your helm chart now?

Also there is a chat going on in Slack. Please check https://vllm-dev.slack.com/archives/C09CTGF8KCN/p1761751362685129

you can use tools/make/helm.mk related make target test. I wrote some comment

Signed-off-by: jishiwen.jsw <jishiwen.jsw@digital-engine.com>
@yuluo-yx yuluo-yx marked this pull request as ready for review November 1, 2025 05:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Semantic Router Helm Chart Support

4 participants