Feature Request: Support for Model settings

[twalderman]

Support Min-P, Repeat Penalty, Repeat Penalty Tokens

[longy2k]

v1.8.4

I have not tested all the parameters but let me know if this work for your use case.

Thanks

EDIT: I noticed the regen/edit is not as random as I want it to be. I set the seed parameter default value to '0' which has caused the model to generate the same response for the same prompt. I will clear the seed parameter tomorrow.

[longy2k]

v1.8.5

Cleared the seed parameter default value.

You may still have to go to Ollama Local LLMS > Advanced Settings > seed and clear the input field.

[twalderman]

It would be good if there was a way to save presets of ollama settings.

[twalderman]

Min_P is not yet supported by Ollama. I put in a feature request for it with the ollama project

More info:

https://www.reddit.com/r/LocalLLaMA/comments/17vonjo/your_settings_are_probably_hurting_your_model_why/