New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

LlamaCpp change breaks Q4_0, Q4_1 and Q8_0 models #101

Closed

su77ungr opened this issue May 20, 2023 · 0 comments

Labels

model

Owner

su77ungr commented May 20, 2023

Issue you'd like to raise.

Not really needed with our default q5 but it should be noted and added so it's within the doc

ggerganov/llama.cpp#1508 (comment)

just a note to myself

Suggestion:

No response

su77ungr added the model label

su77ungr closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment