v1.3.2

🚀 Shepherd Model Gateway v1.3.2 Released

Feature release adding multimodal support to Messages API and Python mesh bindings.

🎨 Multimodal Support for Messages API

Complete vision/image support in Messages API gRPC pipeline:

• Native image processing for Messages API requests
• Works across all gRPC backends (SGLang, vLLM, TensorRT-LLM)
• Full feature parity with Anthropic's Messages API including vision

Impact: Messages API now supports both text and vision workloads. Deploy vision-language models with full reasoning and thinking capabilities through the Messages API protocol.

🌐 Mesh High Availability in Python

--enable-mesh support added to Python bindings:

• Configure mesh HA directly from Python CLI
• Distributed state synchronization accessible from Python deployments
• Complete Python API coverage for mesh features

🐛 Bug Fixes

• API: Restored model_id field in /workers response
• Harmony: Reject ignore_eos with HTTP 400 for compatibility
• Harmony: Include developer message when instructions are present
• Lossy UTF-8 decode fallback for malformed text
• Fixed gRPC PD mode detection
• Enabled loop_controls for Jinja2 templates

📚 Documentation

• Added comprehensive Messages API documentation
• External providers integration guide
• Mesh HA deployment documentation
• Docker/PyPI badges added to README

Full Changelog: v1.3.1...v1.3.2

Upgrade now: pip install smg --upgrade

🐑 Shepherd your LLM infrastructure with confidence.

What's Changed

• fix(api): restore model_id field in /workers response by @slin1237 in #774
• feat(python): add --enable-mesh support to Python bindings by @slin1237 in #775
• fix(ci): bump NCCL to 2.28+ for TensorRT-LLM compatibility by @slin1237 in #777
• fix(harmony): reject ignore_eos for Harmony models with HTTP 400 by @CatherineSue in #778
• fix(ci): install NCCL 2.28+ after TRT-LLM requirements to prevent downgrade by @slin1237 in #779
• fix(harmony): include developer message when instructions are present by @CatherineSue in #781
• feat(gateway): add multimodal support to Messages API gRPC pipeline by @slin1237 in #776
• fix(ci): use k8s pod env vars for API keys instead of GitHub secrets by @slin1237 in #782
• feat(tokenizer): lossy UTF-8 decode fallback, fix gRPC PD mode detection, enable loop_controls by @Kangyan-Zhou in #769
• docs: add Messages API, external providers, and mesh HA documentation by @slin1237 in #786
• docs: add Docker/PyPI badges and release docker notes script by @slin1237 in #787
• chore: add release 1.3.2 by @slin1237 in #780

New Contributors

• @Kangyan-Zhou made their first contribution in #769

Full Changelog: v1.3.1...v1.3.2