-
Notifications
You must be signed in to change notification settings - Fork 88
[GuideLLM Refactor] fix util package types #393
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[GuideLLM Refactor] fix util package types #393
Conversation
Signed-off-by: Jared O'Connell <joconnel@redhat.com>
Signed-off-by: Jared O'Connell <joconnel@redhat.com>
Signed-off-by: Jared O'Connell <joconnel@redhat.com>
Signed-off-by: Jared O'Connell <joconnel@redhat.com>
a5fdee0
to
db43ccd
Compare
self.buffer_receive_queue = culsans.Queue[ReceiveMessageT]( | ||
maxsize=self.max_buffer_receive_size or 0 | ||
) | ||
self.tasks_lock = threading.Lock() |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This was entirely unused. Is that a problem?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yeah I am guessing this is leftover from a previous version. cc: @markurtz
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Some changes needed. But mostly looks good.
self.buffer_receive_queue = culsans.Queue[ReceiveMessageT]( | ||
maxsize=self.max_buffer_receive_size or 0 | ||
) | ||
self.tasks_lock = threading.Lock() |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yeah I am guessing this is leftover from a previous version. cc: @markurtz
Co-authored-by: Samuel Monson <smonson@irbash.net> Signed-off-by: Jared O'Connell <46976761+jaredoconnell@users.noreply.github.com>
538c194
into
vllm-project:features/refactor/base
Summary
This PR fixes all type errors in the utils package. Only a few were ignored.
Details
Test Plan
Run the tests and look through the changes to make sure the logic is equivalent or better to the original code.
Use of AI
## WRITTEN BY AI ##
)