Please help me.

[jeonniga]

How can I use for llama3? it's only supported for openai. is it right?
if you support llama, it seemd to perfect.

[emersonmde]

I just added support for running open source models though Ollama in v0.4.2. See this example for using a local Ollama instance with llama3 installed. Hope this helps!

I plan to add support for directly running LLMs using the rustformers llm crate in the future.