Skip to content

Bug: Model not found using basic example #2

@SchoolyB

Description

@SchoolyB

I am trying to work with the (basic Ollama)[https://github.com/agent-api/examples/blob/main/ollama/basic/main.go] example but I am having an issue.

When using models.GEMMA3_LATEST then building and running the example program
I get the following printed to my console:

2025-03-23T11:12:24.703-0500	INFO	ollama@v0.0.0-20250320002643-ac6641ede049/provider.go:37	 Creating new Provider
2025-03-23T11:12:24.704-0500	INFO	ollama@v0.0.0-20250320002643-ac6641ede049/provider.go:60	 Setting model	 {"modelID": "gemma3:latest"}
2025-03-23T11:12:24.704-0500	DEBUG	agent/agent.go:119	retrieving messages from memory backend
2025-03-23T11:12:24.704-0500	DEBUG	agent/agent.go:125	sending messages{"messages": [{"ID":0,"Role":"user","Content":"Why is the sky blue?","Images":[],"ToolCalls":null,"ToolResult":null,"Metadata":null,"Error":null}]}
2025-03-23T11:12:24.704-0500	DEBUG	agent/agent.go:380	sending message with generate options	 {"genOpts": {"Messages":[{"ID":0,"Role":"user","Content":"Why is the sky blue?","Images":[],"ToolCalls":null,"ToolResult":null,"Metadata":null,"Error":null}],"Tools":[],"Temperature":0,"TopP":0,"MaxTokens":0,"StopSequences":null,"PresencePenalty":0,"FrequencyPenalty":0}}
2025-03-23T11:12:24.704-0500	INFO	ollama@v0.0.0-20250320002643-ac6641ede049/provider.go:67	 Generate request received	 {"modelID": "gemma3:latest"}
2025-03-23T11:12:24.704-0500	INFO	ollama@v0.0.0-20250320002643-ac6641ede049/provider.go:72	 Converting tools to Ollama format	 {"toolCount": 0}
2025-03-23T11:12:24.719-0500	INFO	ollama@v0.0.0-20250320002643-ac6641ede049/provider.go:91	 request failed with status 404: {"error":"model \"gemma3:latest\" not found, try pulling it first"}	  {"client error": "request failed with status 404: {\"error\":\"model \\\"gemma3:latest\\\" not found, try pulling it first\"}"}
2025-03-23T11:12:24.719-0500	INFO	nlp/main.go:109	failed sending message to agent	{"err": "error calling client chat method: request failed with status 404: {\"error\":\"model \\\"gemma3:latest\\\" not found, try pulling it first\"}"}

The very last line saying gemma3:latest was not found even though I do have the gemma3 model through Ollama installed on my machine.

Specs:

OS:      macOS Sequoia 15.0.1 (build: 24A348, kernel: 24.0.0)
CPU:     Apple M2
RAM:     8192 MiB
Ollama Version: 0.6.2
Gemma Version: gemma3:1b

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions