You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
nixos: vllm and sglang are now native systemd units by default. The quadlet-based approach is still available as a fallback for the time being. The new services require users to set up a custom uv workspace to lock dependencies.
Features
couple go binary and systemd module more closely (bbbe7db)
nixos: add systemd-based vllm and sglang services using uv (4917357)
Bug Fixes
nixos: add support for nccl to llama-cpp (fdc9578)