Skip to content

Support remote ollama models#39

Merged
marcorosa merged 3 commits intodevelopfrom
ollama-remote
Mar 25, 2025
Merged

Support remote ollama models#39
marcorosa merged 3 commits intodevelopfrom
ollama-remote

Conversation

@marcorosa
Copy link
Member

Models can be accessed via ollama not only on localhost but also when deployed on remote hosts.

From the host side: it requires serving ollama on 0.0.0.0 instead of localhost, for example following this strategy or this one

@marcorosa marcorosa requested a review from a team as a code owner March 20, 2025 10:35
@marcorosa marcorosa merged commit 28691ef into develop Mar 25, 2025
5 checks passed
@marcorosa marcorosa deleted the ollama-remote branch March 25, 2025 08:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant