Skip to content

Add Ollama service to docker-compose with GPU/CPU auto-detection #3711

Description

@berardifra

Summary

Add the ollama container to the IntelOwl Docker Compose stack as part of the GSoC 2026 LLM Chatbot integration.

Tasks

  • Add ollama service to docker/default.yml (or override, TBD pending mentor input)
  • GPU passthrough config (NVIDIA runtime)
  • CPU fallback for environments without GPU
  • Init script that pulls the default model on first boot
  • Environment variables for LLM config in docker/env_file_app_template

Notes

Part of W1: Infrastructure & Scaffolding. Depends on mentor confirmation on whether Ollama should be optional (override file) or required (base compose).

Metadata

Metadata

Assignees

Labels

gsoc-2026GSoC 2026 - LLM Chatbot project (Francesco Berardi)

Type

No type

Fields

No fields configured for issues without a type.

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions