Skip to content

[v0.1] vLLM Semantic Router Operator Support #98

@Xunzhuo

Description

@Xunzhuo

Adding operator pattern support to vLLM Semantic Router, to largely simplify the UX for automation to model eval, envoy and router startup, observability etc.

similiar to:

  1. aiconfigurator: https://github.com/ai-dynamo/aiconfigurator
  2. ome: https://github.com/sgl-project/ome

refer to: https://lmsys.org/blog/2025-07-08-ome/

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions