Repository navigation
Should sglang load lazily like vllm? #47933
SanjayReddy91
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Same as title but was this an architectural choice? If so what were the reasons in doing so?
I did check for lazy loading in discussions - found none
All reactions