You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi,
thx for your inspiring work, I try to reproduce the work following the Example in the readme, however it seems to raise an error about network connecting, I wonder does the optimization process need http request? can i run in the local
I ran the code by :
python -m awq.entry --model_path /path/to/llama-7b-hf --w_bit 4 --q_group_size 128 --run_awq --dump_awq awq_cache/llama-7b-w4-g128.pt
And the error:
raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
The text was updated successfully, but these errors were encountered:
Hi,
thx for your inspiring work, I try to reproduce the work following the Example in the readme, however it seems to raise an error about network connecting, I wonder does the optimization process need http request? can i run in the local
I ran the code by :
python -m awq.entry --model_path /path/to/llama-7b-hf --w_bit 4 --q_group_size 128 --run_awq --dump_awq awq_cache/llama-7b-w4-g128.pt
And the error:
requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
The text was updated successfully, but these errors were encountered: