-
Notifications
You must be signed in to change notification settings - Fork 59
Closed
Labels
bugSomething isn't workingSomething isn't working
Description
Steps to Reproduce
- Try to launch GPT-oss 120b in a cluster of two mac mini's (I haven't tested other big models, small non-spread models seem fine)
- After the model finishes loading an error occurs
Expected Behavior
I expect the cluster to run like it used to on previous versions
Actual Behavior
An error occurs when the cluster finishes loading on the second node that joins the cluster
Nov 11 10:08:26.559 [ERROR ] launch.py:187 Executor error: cannot access local variable 'http_requests' where it is not associated with a value
Traceback (most recent call last):
File "/Users/niverplast/parallax/src/parallax/launch.py", line 155, in <module>
executor.run_loop()
File "/Users/niverplast/parallax/src/parallax/server/executor.py", line 1207, in run_loop
received_requests = self._join_requests(http_requests, incoming_requests)
^^^^^^^^^^^^^
UnboundLocalError: cannot access local variable 'http_requests' where it is not associated with a value
Nov 11 10:08:26.560 [ERROR ] launch.py:199 cannot access local variable 'http_requests' where it is not associated with a value
Traceback (most recent call last):
File "/Users/niverplast/parallax/src/parallax/launch.py", line 155, in <module>
executor.run_loop()
File "/Users/niverplast/parallax/src/parallax/server/executor.py", line 1207, in run_loop
received_requests = self._join_requests(http_requests, incoming_requests)
^^^^^^^^^^^^^
UnboundLocalError: cannot access local variable 'http_requests' where it is not associated with a value
Version
Environment & Context
- I'm using the latest version.
- I have searched existing issues.
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working