Note: The recommended part is labeled with 🌟.
(1) LangChain🌟
(2) Groq
(1) OpenAI API
(2) Groq API🌟
(3) Nvidia API
Note: I have tried. The service is limited.
A good computer is required to implement the local deployment. Let us consider the deployment based on the API key first.
(2) Ollama (Meta)
I am not sure whether the API key on Groq is totally free. Let us start with some cheap models, e.g., Llama 3.1 8b Instant and Llama3 8b 8192