Skip to content

OME 1.2.1

Choose a tag to compare

View all tags
@github-actions github-actions released this 18 Jul 01:31
· 153 commits to main since this release
v1.2.1
a94dbcd
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

OME 1.2.1

1.2.1 is a small patch release about onboarding a new model family and removing a duplicated source of truth. ThinkingMachines Inkling becomes a servable model family end to end — a new audio-text capability, a capability rule that survives the vision short-circuit, and an NVFP4 runtime — while the GPU instance-type map collapses from two hand-synced copies into one.

✨ Highlights

ThinkingMachines Inkling Support (#672, #674)

Inkling is multimodal in a way the capability pipeline couldn't previously express: it takes audio and text and returns text. This release adds that capability and the runtime to serve it:

  • New AUDIO_TEXT_TO_TEXT capability — added to the ModelCapability enum, the modelconfig capability set, and the modelparser → OME capability mapping, so a parsed Inkling model surfaces the capability on its BaseModel status (#672)
  • Inkling capability rule — models whose type contains inkling_mm_model resolve to both TEXT_TO_TEXT and AUDIO_TEXT_TO_TEXT; the rule is ordered ahead of the vision rule because the vision short-circuit would otherwise return early and silently drop the audio-text output (#672)
  • model_max_length from nested configs — the nested LLM config is now consulted for model_max_length, so checkpoints that only declare it on the inner config no longer parse as 0 (#672)
  • tokenspeed-inkling-nvfp4 runtime — a ServingRuntime for InklingForConditionalGeneration safetensors checkpoints with nvfp4 quantization, autoSelect enabled at priority 1, and a router + ome-container topology requesting 4 GPUs per replica (#674)

One Instance-Type Map Instead of Two (#673)

The instance-type → short-name mapping was maintained in two places that had to agree: the model-agent ConfigMap and the enigma init container's environment. Adding a GPU shape meant editing both, and forgetting one was silent.

  • Single source of truth — the mapping now lives only in modelAgent.instanceTypeMap in values.yaml, rendered by a new ome.instanceTypeMap helper into both the model-agent ConfigMap (instance-type-map) and the enigma init container's INSTANCE_TYPE_MAP env var
  • Onboarding a GPU shape is one edit — add the shape to values.yaml and both consumers pick it up
  • Broader shape coverage — OCI, AWS, Azure, GCP, CoreWeave, and Nebius shapes are enumerated in one place, including B200 and B300

⚠️ Upgrading:

  • Apply the updated CRDs before using AUDIO_TEXT_TO_TEXT. It is a new value in a +kubebuilder:validation:Enum, so a BaseModel carrying it is rejected at admission until the new CRD is applied (#672).
  • Move any instance-type-map override into values.yaml. If you patched the mapping directly in the model-agent ConfigMap, that edit is now overwritten on upgrade and does not reach the enigma init container — set modelAgent.instanceTypeMap instead so both consumers stay in sync (#673).

🚀 Features & Enhancements

  • AUDIO_TEXT_TO_TEXT model capability, wired through the ModelCapability enum, modelconfig, and the modelparser capability mapping (#672)
  • Inkling capability rule resolving inkling_mm_model to TEXT_TO_TEXT + AUDIO_TEXT_TO_TEXT, ordered ahead of the vision rule so the vision short-circuit no longer drops the audio-text output (#672)
  • model_max_length is now merged from nested LLM configs during model config parsing (#672)
  • New tokenspeed-inkling-nvfp4 ServingRuntime for NVFP4 InklingForConditionalGeneration checkpoints, auto-selected at priority 1 (#674)
  • Instance-type → short-name map single-sourced in modelAgent.instanceTypeMap and rendered into both the model-agent ConfigMap and the enigma init container via the ome.instanceTypeMap helper (#673)

♻️ Maintenance

  • Bump bundled image references to v1.2.0 across the Helm chart, the InferenceService ConfigMap, and the kustomize manager / model-agent overlays (#671)

📦 Container Images

The following container images are available:

# OME Manager
docker pull ghcr.io/moirai-internal/ome-manager:v1.2.1

# Model Agent
docker pull ghcr.io/moirai-internal/model-agent:v1.2.1

# OME Agent
docker pull ghcr.io/moirai-internal/ome-agent:v1.2.1

# Multinode Prober
docker pull ghcr.io/moirai-internal/multinode-prober:v1.2.1

⎈ Helm Installation

Option 1: OCI Registry (Recommended)

# Install directly from OCI registry
helm install ome-crd oci://ghcr.io/moirai-internal/charts/ome-crd --version 1.2.1 --namespace ome --create-namespace
helm install ome oci://ghcr.io/moirai-internal/charts/ome-resources --version 1.2.1 --namespace ome

Option 2: GitHub Releases

# Add the OME Helm repository
helm repo add ome https://github.com/ome-projects/ome/releases/download/v1.2.1
helm repo update

# Install OME
helm install ome-crd ome/ome-crd --namespace ome --create-namespace
helm install ome ome/ome-resources --namespace ome

📋 Changelog

Full Changelog: v1.2.0...v1.2.1

📄 Software Bill of Materials

SBOMs are available in both SPDX and CycloneDX formats for:

  • Source code
  • All container images

🔐 Signatures

All container images are signed with cosign. Verify with:

cosign verify ghcr.io/moirai-internal/ome-manager:v1.2.1   --certificate-identity-regexp=https://github.com/ome-projects/ome/.github/workflows/release.yaml@refs/tags/.*   --certificate-oidc-issuer=https://token.actions.githubusercontent.com

What's Changed

Contributors

pallasathena92
Assets 24
Loading