Add AWQ support for all models

[WoosukKwon]

Fixes #1682

This PR adds AWQ support for all models, by adding ScaledActivation.

• Tested:

• MPT
• Falcon
• BLOOM
• GPTBigCode
• GPT-J
• OPT (125M)

I didn't test AWQ for GPT2, GPT-NeoX, and Phi models, since I couldn't find their quantized weights in HF model hub.

[casper-hansen]

FYI, Phi is not yet supported in AutoAWQ as there are some blockades associated with their architecture that have yet to be resolved. GPT-2 is also not supported yet, although I can add it if the community wants it.

[WoosukKwon]

Hi @casper-hansen, thanks for letting us know! Could you elaborate more on this?

Phi is not yet supported in AutoAWQ as there are some blockades associated with their architecture

I thought the Phi's architecture is not very different from other GPT models.

[zhuohan123]

LGTM! Thanks for the quick fix!

[lonngxiang]

can awq model use vllm.entrypoints.openai.api_server？

i test can run， but request cannot sucess

import openai
import json


# Modify OpenAI's API key and API base to use vLLM's API server.
openai.api_key = "EMPTY"

model = "AquilaChat2-7B"

openai.api_base = "http://localhost:10860/v1"

def test_chat_completion():
    message=[{"role": "user","content":"介绍下广州一日游?"}]
    res = openai.ChatCompletion.create(model =model, messages=message)
    # print(type(res),res)

    content= res["choices"][0]["message"]["content"]
    
    print(content)

error: