Releases
v0.10.17
Compare
Sorry, something went wrong.
No results found
Features
add OCI registry publishing for model prefetch (#2324 ) (bfd5622 )
cli: support runtime-aware model catalog entries (#2360 ) (9fb7206 )
metal: join passes agent flags, keeps them on a re-join, and checks the Mac before it spends the string (#2433 ) (704696a )
metal: say when macOS Local Network access may be blocking the API server (#2437 ) (8cd015b )
model: expand spec.files globs from a listing pod, so the controller needs no egress (#2453 ) (cf9daa5 )
models: support staging files from multiple repositories (#2316 ) (fa4c273 )
model: stage spec.files concurrently with spec.downloadConcurrency (#2371 ) (f04c9ca )
router: name the router-proxy Service with spec.proxy.serviceName (#2374 ) (30a1d77 )
router: prefix affinity for ModelRouter LoadAware backends (#2447 ) (a1fab9c )
Bug Fixes
chart: page InferenceAdmissionStalled on vLLM and SGLang only without progress (#2465 ) (8d13568 )
chart: print the Blackwell platform floors only when asked (#2430 ) (0c15420 )
cli: deploy leaves the image to the operator and picks the --gpu accelerator from the cluster (#2429 ) (b53e180 )
cli: never write an insecure fleet edge kubeconfig unasked (#2431 ) (0f4fa2b )
deps: bump klauspost/compress to v1.20.3 for GO-2026-6865 (#2466 ) (e0c6c17 )
gguf: reject nested metadata arrays and cap array preallocation (#2445 ) (7e99868 )
metal: keep the agent serving through API server outages (#2434 ) (fc255f1 )
metal: register the address the MetalNode dial-back verified (#2432 ) (4a605a2 )
metal: size linked model files by what the links point to (#2444 ) (4e06dfb )
metal: stop the engines on brew uninstall --zap (#2435 ) (6640f44 )
model: keep the serial downloader so an upgrade doesn't restart serving pods (#2463 ) (912dce7 )
modelpool: hold router activations for every invalid-members reason (#2373 ) (81af45b )
prefetch: run prefetched pods in the prefetch Job's group, and report unreadable files (#2452 ) (bf3e8c5 )
router: count unserved requests and quarantine endpoints whose load polls fail (#2440 ) (cec3b18 )
router: export router-proxy spans over OTLP (#2423 ) (6c0ee67 )
router: label every proxy metric with the router's name (#2456 ) (1185be2 )
router: refuse detector and hybrid classification modes on the Proxy data plane (#2424 ) (d6d19f1 )
Performance Improvements
model: poll staging downloads in tenths of a second (#2394 ) (a8b91ef )
Documentation
make the README and entry-point docs match the code (#2426 ) (6c9b91c )
metal: put the brew and join path first in the macOS docs and state the Mac's limits (#2428 ) (be4834f )
You can’t perform that action at this time.