Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

deployment with docker compose #1430

Open
wwjCMP opened this issue May 29, 2024 · 1 comment
Open

deployment with docker compose #1430

wwjCMP opened this issue May 29, 2024 · 1 comment

Comments

@wwjCMP
Copy link

wwjCMP commented May 29, 2024

How do I set up my deployment with docker compose to use the ollama model and ollama Embed model

@sarahwooders
Copy link
Collaborator

We've only tested with OpenAI so far, so not sure if it'll work with Ollama (you can do memgpt server and that should work with Ollama though). We also are adding embedding support in #1384.

It's a bit hacky right now, but the following might also work

  1. Install pip install pymemgpt
  2. Run memgpt configure and configure Ollama settings
  3. Run docker compose up and change this line to point to your file ~/.memgpt/config

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: To triage
Development

No branches or pull requests

2 participants