Falcon-180B Quantization Support

[tresiwald]

Love the LLAMA2-AWQ support, really handy!
Are there any plans to support Falcon-180B-AWQ in the near future?

[WoosukKwon]

Hi @tresiwald, thanks for the request. This should be supported in the new version (v0.2.2), which was just released. Please try out the new version and let us know if you find any error.