You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
v0.6.0 — SGLang and TGI engines, engine versions on the dashboard
This commit was created on GitHub.com and signed with GitHub’s verified signature.
Changes
Refresh SGLang integration and parser choices for SGLang v0.5.22. Correct host binding, GPU selection, executable choice, and multimodal guidance.
Add Hugging Face TGI v3.3.7 as a Docker engine, with setup guidance and conservative fit estimates. TGI is archived upstream.
Support Podman's Docker command wrapper for TGI GPU selection, and require the exact launch image tag when detecting its availability. Clean temporary token files after failed container exits and support multiple selected GPUs.
Show installed llama.cpp, vLLM, SGLang and Docker engine versions beside cached latest GitHub release versions on the Dashboard.
Keep engine versions readable when an executable path is long or the dashboard is narrow.
Expose llama.cpp prompt chunk reuse and vLLM CPU KV cache offloading.
Keep SGLang API keys out of launcher controls because v0.5.22 logs its server arguments. Correct its quantization choices and align model fit recommendations with the Launch default.