ValueError: Target module WQLinear_GEMM is not supported. Currently, only `torch.nn.Linear` and `Conv1D` are supported.- AWQ Quantisation Issues

[Vasanth03]

Hi @casper-hansen

-> I am trying to train the AWQ quantised model using hugging face trainer.
While using PEFT (LoRA adaptor) the following error pops up.

-> This is the version that I have used !pip install -q -U https://github.com/casper-hansen/AutoAWQ/releases/download/v0.1.6/autoawq-0.1.6+cu118-cp310-cp310-linux_x86_64.whl

Any help is much appreciated. Thanks

Originally posted by @Vasanth03 in #27321 (comment)

[casper-hansen]

Hi @Vasanth03, AutoAWQ is not compatible with training yet. It will be in the future though.

[Vasanth03]

Thank you so much @casper-hansen. And I look forward to its compatibility in the future.