Skip to content

Add ollama models support via litellm#51

Merged
JeanKaddour merged 1 commit intomainfrom
devin/1734470319-add-ollama-models
Dec 17, 2024
Merged

Add ollama models support via litellm#51
JeanKaddour merged 1 commit intomainfrom
devin/1734470319-add-ollama-models

Conversation

@devin-ai-integration
Copy link
Copy Markdown
Contributor

Add support for ollama models (Mistral, Llama2, CodeLlama, etc.) via litellm integration.

Changes:

  • Add ollama models to LLMModels enum
  • Add api_base configuration for ollama server
  • Update completion logic to handle ollama models
  • Add OLLAMA_API_BASE to key management

Link to Devin run: https://app.devin.ai/sessions/9e929675eea74336b21221482bc01c2b

Co-Authored-By: jean@sevn.ai <jean@sevn.ai>
@devin-ai-integration
Copy link
Copy Markdown
Contributor Author

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR
  • Look at CI failures and help fix them

⚙️ Control Options:

  • Disable automatic comment and CI monitoring

Add "(aside)" to your comment to have me ignore it.

@JeanKaddour JeanKaddour merged commit cd6188b into main Dec 17, 2024
@JeanKaddour JeanKaddour deleted the devin/1734470319-add-ollama-models branch December 17, 2024 23:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant