Skip to content

v0.7.6

Choose a tag to compare

View all tags
@github-actions github-actions released this 31 Jul 21:37
· 244 commits to main since this release
v0.7.6
1ae763c

Native install (Apple Silicon / homelab)

uv tool install "mship[metal]"
mship deploy --config models.yaml

Docker images

Thin (control/coordinator — default, no torch/vllm)

docker pull ghcr.io/alez007/modelship:0.7.6

CUDA (GPU node)

docker pull ghcr.io/alez007/modelship:0.7.6-cuda

CPU (CPU node)

docker pull ghcr.io/alez007/modelship:0.7.6-cpu

Floating tags (:latest, :latest-cuda, :latest-cpu) are single-node only — for any
multi-node cluster, pin every node to the same X.Y.Z tag to avoid a Ray version
mismatch between head and workers.

Helm chart (Kubernetes)

helm install modelship \
  oci://ghcr.io/alez007/charts/modelship \
  --version 0.7.6 \
  -f values.yaml

Configuration

Create a models.yaml file and mount it at /modelship/config/models.yaml. Example configs for various GPU sizes are included in the image under /modelship/config/ — use them as a reference for structure and available options, then tailor the models and GPU fractions to your hardware.

What's Changed

  • chore: add CLA, CODEOWNERS, and governance docs for contributors by @alez007 in #146
  • Fix/mcp policy shape validation by @alez007 in #147
  • Chore/upgrade vllm 0.26.0 by @alez007 in #148
  • fix: auto-detect free host RAM for Ray node memory sizing by @alez007 in #149
  • chore: bump llama.cpp to b10200 by @github-actions[bot] in #150

Full Changelog: v0.7.5...v0.7.6

Contributors

alez007
Assets 2
Loading