Skip to content

Inference Stack 0.1.1 preview

Pre-release
Pre-release

Choose a tag to compare

@moe-berri moe-berri released this 22 Nov 01:42
e57ae3d

This preview fixes the first Deploy click after changing model settings.

The README now has a shorter quickstart, an updated stack animation, and the blue LiteLLM logo in both themes. LiteLLM routes to models; llm-d selects a vLLM replica.

Set up Inference Stack · Update from v0.1.0

Docker and Kubernetes flows were tested with simulated models. Native amd64 and arm64 launcher smoke tests passed. Real-GPU model execution remains unverified; simulation returns canned responses.

Release assets and container images are built and signed by the private release pipeline. The manifest records the source commit and image digest.