v0.7.14

Native install (Apple Silicon / homelab)

uv tool install mship
mship bootstrap --metal
mship deploy --config models.yaml

Docker images

Thin (control/coordinator — default, no torch/vllm)

docker pull ghcr.io/modelship-ai/modelship:0.7.14

CUDA (GPU node)

docker pull ghcr.io/modelship-ai/modelship:0.7.14-cuda

CPU (CPU node)

docker pull ghcr.io/modelship-ai/modelship:0.7.14-cpu

Floating tags (:latest, :latest-cuda, :latest-cpu) are single-node only — for any
multi-node cluster, pin every node to the same X.Y.Z tag to avoid a Ray version
mismatch between head and workers.

Helm chart (Kubernetes)

helm install modelship \
  oci://ghcr.io/modelship-ai/charts/modelship \
  --version 0.7.14 \
  -f values.yaml

Running an image

The images take the same subcommands as the mship CLI:

docker run --rm --shm-size=8g \
  -v ./models.yaml:/modelship/config/models.yaml \
  -v ./models-cache:/.cache \
  -p 8000:8000 \
  ghcr.io/modelship-ai/modelship:0.7.14-cpu deploy

Configuration

Create a models.yaml file and mount it at /modelship/config/models.yaml. Example configs for various GPU sizes are included in the image under /modelship/config/examples/ — use them as a reference for structure and available options, then tailor the models and GPU fractions to your hardware.

What's Changed

• Fix/gemma4 vllm support by @alez007 in #180
• Fix/llama server sliding window preflight by @alez007 in #181
• Fix/mla preflight sizing by @alez007 in #183
• Fix/hybrid preflight sizing by @alez007 in #184
• fix: log silent ErrorResponse paths and validate tool_choice at the s… by @alez007 in #185
• Feat/devcontainer llama server provisioning by @alez007 in #186
• fix: emit an SSE error chunk on mid-stream failures instead of aborting by @alez007 in #187
• feat: aggregate HF model download progress and add a heartbeat by @alez007 in #188
• Feat/cli nested model flags by @alez007 in #189

Full Changelog: v0.7.13...v0.7.14