Repository navigation
Inference Stack 0.1.1 preview
Pre-release
Pre-release
This preview fixes the first Deploy click after changing model settings.
The README now has a shorter quickstart, an updated stack animation, and the blue LiteLLM logo in both themes. LiteLLM routes to models; llm-d selects a vLLM replica.
Set up Inference Stack · Update from v0.1.0
Docker and Kubernetes flows were tested with simulated models. Native amd64 and arm64 launcher smoke tests passed. Real-GPU model execution remains unverified; simulation returns canned responses.
Release assets and container images are built and signed by the private release pipeline. The manifest records the source commit and image digest.