[HELP] - Trying to integrate Ollama CLI.

[w0nam]

Hello, lads!

I've been running iNiR for about a day or so, and I'm in LOVE!

The only thing, like ONLY thing, that's pissing me off a bit is the fact that I'm "forced" to use OpenRouter services for the AI widget. Don't get me wrong, it's free and mostly works really well, but I have already modified a llama3.2 model for my use case, and I want to utilize it in the widget.

Since I'm quite new to iNiR, I don't want to nuke my entire installation, (though it is already backed up), so I'm asking for help:

How can I use Ollama/llama3.2:latest locally in iNiR's AI widget?

Thanks for reading me out!