Skip to content

Supported Model in README #60

Answered by mobicham
sanjeev-bhandari asked this question in Q&A
Discussion options

You must be logged in to vote

Hi, I think it's quite clear.
If a Hugging Face model is not on the list (llama, Mistral, Mixtral, Phi), use auto mode: https://github.com/mobiusml/hqq/?tab=readme-ov-file#auto-mode-1
Auto-mode basically tries to figure out how to quantize stuff automatically, but it's not guaranteed to work.

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by mobicham
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants