-
-
Notifications
You must be signed in to change notification settings - Fork 429
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix(vllm): fix up vllm 0.4.2 #1635
Conversation
5feb137
to
9de3bbe
Compare
NixOS/nixpkgs#309477 is needed to investigate the circular dependencies between fastapi and fastapi-cli. |
@Atry I added an override for |
Copying the so file to a path under tmpdir does not make sense. It would be discarded immediately. Users still need to set the environment variable even when |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
triton
needs setuptools
@cpcloud Do you want to merge this PR? |
Contribution checklist (recommended but not always applicable/required):