v0.7.9

Native install (Apple Silicon / homelab)

uv tool install "mship[metal]"
mship deploy --config models.yaml

Docker images

Thin (control/coordinator — default, no torch/vllm)

docker pull ghcr.io/modelship-ai/modelship:0.7.9

CUDA (GPU node)

docker pull ghcr.io/modelship-ai/modelship:0.7.9-cuda

CPU (CPU node)

docker pull ghcr.io/modelship-ai/modelship:0.7.9-cpu

Floating tags (:latest, :latest-cuda, :latest-cpu) are single-node only — for any
multi-node cluster, pin every node to the same X.Y.Z tag to avoid a Ray version
mismatch between head and workers.

Helm chart (Kubernetes)

helm install modelship \
  oci://ghcr.io/modelship-ai/charts/modelship \
  --version 0.7.9 \
  -f values.yaml

Configuration

Create a models.yaml file and mount it at /modelship/config/models.yaml. Example configs for various GPU sizes are included in the image under /modelship/config/ — use them as a reference for structure and available options, then tailor the models and GPU fractions to your hardware.

What's Changed

• fix: cut library log noise, prefix and de-duplicate startup log lines by @alez007 in #154
• fix: close vLLM cross-identity prefix-cache timing side channel by @alez007 in #155
• fix: refresh stale and broken model references in example configs by @alez007 in #157
• fix: crash the replica actor when a loader's backend dies unexpectedly by @alez007 in #158
• fix: raise onnxruntime-gpu floor to 1.28.0 for CUDA 13 compatibility by @alez007 in #159
• feat: promote whispercpp to a first-class in-process loader by @alez007 in #160
• refactor: remove the whispercpp plugin, superseded by loader: whispercpp by @alez007 in #161
• feat: add sherpa_onnx TTS loader (kokoro, CPU/CoreML, streaming) by @alez007 in #162
• refactor: remove the plugin system by @alez007 in #163

Full Changelog: v0.7.8...v0.7.9