Skip to content

v1.8.1

Latest

Choose a tag to compare

@kossakovsky kossakovsky released this 23 Jul 19:53
5920dd6

Added

  • Ollama — Runtime tuning via .env: OLLAMA_MAX_LOADED_MODELS, OLLAMA_NUM_PARALLEL, OLLAMA_GPU_OVERHEAD (in bytes), OLLAMA_CONTEXT_LENGTH and OLLAMA_KV_CACHE_TYPE were hardcoded (or unavailable) in docker-compose.yml and are now configurable, so multi-GPU hosts can keep more models resident and reserve VRAM for other tools sharing a GPU. The previously hardcoded values stay as the stack's defaults, and the two new variables are unset/zero by default so Ollama's stock behavior applies — existing installs are unaffected (#99).
  • Caddyhost.docker.internal now resolves from the Caddy container (via extra_hosts: host-gateway), so custom caddy-addon/site-*.conf entries can reverse-proxy services running on the host machine (#100).

Changed

  • Docs — README now documents the update-safe extension points (caddy-addon/site-*.conf, docker-compose.override.yml, .env), and caddy-addon/README.md gained a reverse-proxy example for stack-external services, including the UFW rule needed for container-to-host traffic. The persistent-Caddy-entries mechanism requested in #100 already existed but was easy to miss (#100).

Upgrade

make update

The new OLLAMA_* variables are added to your .env automatically with behavior-preserving values — edit them and run make restart to tune. To expose a service running outside the stack, drop a site-<name>.conf file into caddy-addon/ (see caddy-addon/README.md); it survives future updates.

Full Changelog: v1.8.0...v1.8.1