Skip to content

Commit

Permalink
awq typo
Browse files Browse the repository at this point in the history
  • Loading branch information
flozi00 committed May 22, 2024
1 parent a20bc03 commit ab80c15
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion server/lorax_server/layers/linear.py
Original file line number Diff line number Diff line change
Expand Up @@ -156,7 +156,7 @@ def get_linear(weight, bias, quantize, fan_in_fan_out=False):
qweight, qzeros, scales, _, bits, groupsize, _ = weight
except Exception:
raise NotImplementedError("The passed weight is not compatible with `awq`")
from lorax_server.lorax_server.utils.awq.awq import AWQLinear
from lorax_server.utils.awq.awq import AWQLinear
linear = AWQLinear(
w_bit=bits,
group_size=groupsize,
Expand Down

0 comments on commit ab80c15

Please sign in to comment.