Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature Request]: Ollama support #7487

Closed
mchiang0610 opened this issue Aug 30, 2023 · 3 comments · Fixed by #7635
Closed

[Feature Request]: Ollama support #7487

mchiang0610 opened this issue Aug 30, 2023 · 3 comments · Fixed by #7635
Labels
enhancement New feature or request triage Issue needs to be triaged/prioritized

Comments

@mchiang0610
Copy link

Feature Description

Adding Ollama support:

ollama/ollama#278

Reason

No response

Value of Feature

No response
@mchiang0610 mchiang0610 added enhancement New feature or request triage Issue needs to be triaged/prioritized labels Aug 30, 2023
@hammer
Copy link

hammer commented Sep 6, 2023

Ollama is the easiest way to get a local LLM working on macOS that I've found, it would be great if their interface was supported by LlamaIndex!

@shauryr
Copy link

shauryr commented Sep 8, 2023 •
edited

new litellm integration PR #7600
If we have litellm; we can also get ollama working through it - https://github.com/BerriAI/litellm/blob/main/cookbook/liteLLM_Ollama.ipynb

@krrishdholakia
Copy link
Contributor

@logan-markewich has given me some feedback on the PR - i'll work on it and make the integration hopefully by EOD

@pjerryhu pjerryhu mentioned this issue Sep 11, 2023
Merged
9 tasks
@shauryr shauryr mentioned this issue Sep 13, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request triage Issue needs to be triaged/prioritized
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Adding Ollama Support pjerryhu/llama_index
4 participants
@hammer @mchiang0610 @shauryr @krrishdholakia