Lora models / Lora training

[AncientMystic]

Would it be possible to somehow add lora support just like embedding support? That way we can load lora models to be used in the execution of text generation models in order to fine tune their output?

Also wondering if it would be possible to add lora training so we could train a lora directly via ollama to run on top of models

I have noticed loras seem to really improve the results of models so it would be nice to be able to directly support loading them on top of models within ollama

[thinkverse]

Ollama does support LoRA, add it as an adapter in a Modelfile, read more about it here: https://github.com/ollama/ollama/blob/798b107f19ed832d33a6816f11363b42888aaed3/docs/modelfile.md#adapter

[AncientMystic]

Thank you for the response, i will play around with it 👍