Struggling with getting the model to work after launching it.

[dennisdoes]

Installed docker and launched ollama and odysseus in docker.

Installed 3 different low-mem models to test out, but when I launch a model, start a new chat, select the model in the top right corner of the chat, and send a message I just get 503 errors. (See example below)

Tried using Gordon in Docker to figure out if there was some kind of error between the odysseus container and the ollama container and gordon did a bunch of things, however I still cant get it to respond to any messages.

Setting up LMStudio was an absolute breeze compared to this, but I'd love to get this working and try it out.

Can anyone point me in the right direction? Thanks.

[RaresKeY]

A 503 here means Odysseus is not getting a usable response from the configured model-serving endpoint, but the screenshot hides the underlying error. One important detail is that gemma-1.1-2b-it-GGUF looks like a Hugging Face/Cookbook GGUF model normally served with llama.cpp, rather than an Ollama model tag. Could you confirm whether that exact model was pulled with Ollama or downloaded and launched through Odysseus Cookbook?

Please also share, with keys and passwords redacted: how you installed Odysseus; the Odysseus version/commit or exact image tag; docker ps --format 'table {{.Names}}\t{{.Image}}\t{{.Status}}\t{{.Networks}}'; the configured model endpoint type and base URL; the exact three model names; and any Cookbook launch command/troubleshooting output.

Immediately after reproducing the failure, please include the last 200 lines from the Odysseus container and whichever service is actually hosting this model. If possible, open browser DevTools, select Network, open /api/chat_stream, and paste the first event: error JSON, since that should contain the useful message currently hidden behind "Error 503." Also let us know what Gordon changed in the Docker configuration.

[SirThinksAl0t]

ERROR 503 happened to me too, I don't know why, It only worked when I turned on "Agent" mode and assigned a "Workspace" folder, only then it responded, and after that I could turn it back off into "Chat" mode.

What was my question or prompt❓ I only said "Hello" in an empty new chat
Why❓❗ No idea.
Is it a bug❓❗ No idea.