You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Searching for models gives no option to select the quant size and seems to favour f32 which is a bit overkill IMO 🤣, searching with a specific quant size returns a completely different model
Steps to Reproduce
Search for Phi 3.1
Returns results for F32
No option to select the quant type/size
Search for Phi 3.1 Q6_K
Note that it returns results for llama3?
Expected Behaviour
Be able to search for a model and have it suggest a reasonable quant size (e.g. Q6_K, Q5_K_M and Q4_K_M) by default.
Be able to search for a model and it's quant size and have it return that model and quant size (rather than a different model entirely)
Your Environment
GPT4All version: 3.0.0
Operating System: macOS (latest)
Chat model used (if applicable): N/A
The text was updated successfully, but these errors were encountered:
Bug Report
Searching for models gives no option to select the quant size and seems to favour f32 which is a bit overkill IMO 🤣, searching with a specific quant size returns a completely different model
Steps to Reproduce
Expected Behaviour
Be able to search for a model and have it suggest a reasonable quant size (e.g. Q6_K, Q5_K_M and Q4_K_M) by default.
Be able to search for a model and it's quant size and have it return that model and quant size (rather than a different model entirely)
Your Environment
The text was updated successfully, but these errors were encountered: