We need a PD instance created by LWS that can be managed via RBG resource management. This is to reduce the amount of YAML writing and more conveniently manage prefill and decode type workloads. Below is a well-organized LWS example of mine; we need to adapt it to the RBG version.
https://github.com/whybeyoung/awesome-sglang/tree/main/k8s/lws/deepseekv3
Thankyou
We need a PD instance created by LWS that can be managed via RBG resource management. This is to reduce the amount of YAML writing and more conveniently manage prefill and decode type workloads. Below is a well-organized LWS example of mine; we need to adapt it to the RBG version.
https://github.com/whybeyoung/awesome-sglang/tree/main/k8s/lws/deepseekv3
Thankyou