Skip to content

v0.9.8

Choose a tag to compare

@github-actions github-actions released this 20 Jul 03:32
368dfc2

0.9.8 (2026-07-19)

Features

  • controller: add InferenceService hardware-labels info metric (#1121) (#1160) (039adaa)
  • controller: add llamacpp-router runtime for multi-model serving (#1152) (fae5983)
  • controller: explicit vllm serve entrypoint for image-agnostic vLLM (#1164) (#1165) (3eeb580)
  • controller: pass staged model directory to vLLM/SGLang for multi-file models (#1157) (#1159) (a24fa94)
  • controller: ROCm/HIP runtime tier for AMD nodes (#701) (#1154) (3704d47)
  • finalize: gate foreman-finalize on the Foreman verify verdict (#1150) (#1153) (5c7b2cd)
  • foreman: in-executor envtest gate feedback loop (#768) (#1135) (074544a)
  • foreman: provider-neutral CodeHost/WorkItems/ChangePolicy seams (#1158) (#1161) (d3a8ad6)
  • observability: per-InferenceService SLO declaration via Pyrra (#415) (#1149) (4ae022c)

Bug Fixes

Documentation