Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Searching for models returns f32 models and no option to select the quant size #2526

Open
sammcj opened this issue Jul 2, 2024 · 1 comment
Labels
bug-unconfirmed chat gpt4all-chat issues

Comments

@sammcj
Copy link

sammcj commented Jul 2, 2024

Bug Report

Searching for models gives no option to select the quant size and seems to favour f32 which is a bit overkill IMO 🤣, searching with a specific quant size returns a completely different model

image image

Steps to Reproduce

  1. Search for Phi 3.1
  2. Returns results for F32
  3. No option to select the quant type/size
  4. Search for Phi 3.1 Q6_K
  5. Note that it returns results for llama3?

Expected Behaviour

Be able to search for a model and have it suggest a reasonable quant size (e.g. Q6_K, Q5_K_M and Q4_K_M) by default.

Be able to search for a model and it's quant size and have it return that model and quant size (rather than a different model entirely)

Your Environment

  • GPT4All version: 3.0.0
  • Operating System: macOS (latest)
  • Chat model used (if applicable): N/A
@sammcj sammcj added bug-unconfirmed chat gpt4all-chat issues labels Jul 2, 2024
@uninstall-your-browser
Copy link

It would be nicer if it just listed the quant options available like lm-studio does

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug-unconfirmed chat gpt4all-chat issues
Projects
None yet
Development

No branches or pull requests

2 participants