-
-
Notifications
You must be signed in to change notification settings - Fork 23
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
App crashes on loading local model. #20
Comments
Can you provide a link to the model file used? |
It seems to be attempting to access memory outside its buffer, likely a llama.rn issue. |
okay, are you sending the whole conversation history as a prompt or just the current message? |
The app fills the context with the latest message history until the context limit is reached. |
No this is simply how LLMs function, they take a step to consume context and build the KV. Next time, I would recommend not bringing up unrelated topics. This is an issue tracker not code support forum. |
sure |
Using StableLm-2-zephyr-1_6b-q1_1.gguf 6gb ram android 11.
The text was updated successfully, but these errors were encountered: