You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi, thanks for the interests! AWQ should theoretically support different LLM designs, but we need to implement the support (just a few lines of code). Please refer to awq/quantize/pre_quant.py and awq/quantize/auto_scale.py for model-specific implementations.
great work! but how to use awq in my own model?
The text was updated successfully, but these errors were encountered: