Skip to content

BYOK timeout for ollama models #251019

@TylerLeonhardt

Description

@TylerLeonhardt

Steps to Reproduce:

  1. Install Ollama
  2. ollama run devstral:24b - https://ollama.com/library/devstral
  3. kill ollama if it's running
  4. OLLAMA_CONTEXT_LENGTH=131072 ollama serve
  5. Add this model to chat
  6. Go to Agent mode and ask it to do something
  7. wait a long time (expected)... but eventually you get this:
Image

I tried loading this same model into Roo Code & it worked:
Image

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions