can i use custom llm instead of openai?

[Playerrrrr]

as the title says

[aronweiler]

So I used to have this set up to do that, but unfortunately I didn't have the time to maintain the prompts properly, and the results I was getting were garbage (you really need separate / different prompts for different LLMs to have them work effectively).

It's on my radar to put back in, but as of right now I cut this down to only work with the OpenAI LLMs.

It will probably be a while before I get to re-adding the local/custom LLM support, but I'm always open to outside contributions if you want to help me add it in :)