Groq API in PrivateGPT

[psmukhopadhyay]

Hello

I am a beginner-level user of PrivateGPT and set it for 'local' with LLM as mistral-7b-instruct-v0.2.Q4_K_M.gguf.

Please advise me how to add Groq (OpenAI compatible LLM service - https://console.groq.com/docs/quickstart) in PrivateGPT. I already have API key and other ID for Groq. Should I follow the included azopenai as model?

Regards

[KenFlack]

I am in the same boat... Will let you know if I discover the solution.

[psmukhopadhyay]

Thanks Ken :)