OME 1.1.0

OME 1.1.0

This release is about controlling when runtime changes reach your services: InferenceServices can now pin to immutable ServingRuntime snapshots with explicit roll-forward and rollback, explicit runtime selection no longer hard-fails on compatibility, and model downloads got faster and more resilient.

✨ Highlights

Runtime Revision Pinning (#639, #640)

Until now, every InferenceService tracked its ServingRuntime live — editing a shared runtime rippled into every service referencing it, immediately, with no staging and no way back. This release makes that coupling opt-out:

• Pin — set spec.runtime.autoSync: false and the service freezes on an immutable, content-addressed snapshot of its runtime, backed by ControllerRevisions
• Roll forward — bump the ome.io/runtime-sync annotation to re-sync to the latest runtime on your own schedule
• Roll back — set spec.runtime.revision to return to any retained snapshot
• See drift — a RuntimeDrifted status condition surfaces when a pinned service has fallen behind the live runtime
• Stay clean — stale snapshots are garbage-collected automatically, with tunable retention and grace-period flags
• No surprises — live tracking remains the default; nothing changes unless you opt in

Explicit Runtime Compatibility Is Now Advisory (#643)

• Naming a runtime explicitly with a declared model-format or architecture mismatch no longer hard-fails the InferenceService
• The service proceeds and emits a warning event instead, matching the admission webhook's existing behavior
• Generic runtimes can now serve architectures they don't enumerate — you stay informed without being blocked

Faster, More Robust Model Downloads (#629, #644, #645)

• OCI Object Storage downloads are skipped when a same-path artifact is already Ready — nodes stop re-pulling weights they already have (#629)
• The same-path shortcut is bypassed when a download override is set, so forced re-downloads still behave as expected (#645)
• HuggingFace downloads in the replica agent now have timeouts — stalled transfers fail fast instead of hanging (#644)

⚠️ Upgrading: runtime revision pinning requires the controller-manager to have create on controllerrevisions.apps. The bundled charts and manifests include this grant (#646) — if you manage RBAC out of band, add it before pinning any service.

🚀 Features & Enhancements

• Content-addressed runtime snapshot machinery, backed by ControllerRevisions (#639)
• Runtime revision controls on InferenceService: spec.runtime.autoSync, spec.runtime.revision, the RuntimeDrifted condition, and snapshot GC flags (#640)
• Explicit-runtime compatibility mismatches downgraded from a hard failure to a warning event (#643)
• HuggingFace download timeout for the replica agent (#644)
• Skip OCI Object Storage downloads for Ready same-path artifacts (#629); bypass the reuse when a download override is set (#645)

🐛 Bug Fixes

• Grant the controller-manager create on controllerrevisions.apps, required for runtime revision pinning (#646)

📚 Documentation

• Docs backfill (#648):
  • Runtime revisions guide
  • Controller-manager configuration
  • Quantization, including compressed-tensors
  • Annotations & labels reference
  • Rewritten fine-tuned-weights guide
  • Regenerated API reference
• Fixed the GitHub Pages build on Hugo 0.157.0 / Docsy v0.15.0 (#642); bumped autoprefixer 10.4.23 → 10.5.0

♻️ Maintenance

• Hardened the xet cargo build against transient network failures (#641)

📦 Container Images

The following container images are available:

# OME Manager
docker pull ghcr.io/moirai-internal/ome-manager:v1.1.0

# Model Agent
docker pull ghcr.io/moirai-internal/model-agent:v1.1.0

# OME Agent
docker pull ghcr.io/moirai-internal/ome-agent:v1.1.0

# Multinode Prober
docker pull ghcr.io/moirai-internal/multinode-prober:v1.1.0

⎈ Helm Installation

Option 1: OCI Registry (Recommended)

# Install directly from OCI registry
helm install ome-crd oci://ghcr.io/moirai-internal/charts/ome-crd --version 1.1.0 --namespace ome --create-namespace
helm install ome oci://ghcr.io/moirai-internal/charts/ome-resources --version 1.1.0 --namespace ome

Option 2: GitHub Releases

# Add the OME Helm repository
helm repo add ome https://github.com/ome-projects/ome/releases/download/v1.1.0
helm repo update

# Install OME
helm install ome-crd ome/ome-crd --namespace ome --create-namespace
helm install ome ome/ome-resources --namespace ome

📋 Changelog

📄 Software Bill of Materials

SBOMs are available in both SPDX and CycloneDX formats for:

• Source code
• All container images

🔐 Signatures

All container images are signed with cosign. Verify with:

cosign verify ghcr.io/moirai-internal/ome-manager:v1.1.0   --certificate-identity-regexp=https://github.com/ome-projects/ome/.github/workflows/release.yaml@refs/tags/.*   --certificate-oidc-issuer=https://token.actions.githubusercontent.com

What's Changed

• [Core] Add runtime revision snapshot machinery by @pallasathena92 in #639
• [Core] add runtime revision support in isvc by @pallasathena92 in #640
• [Misc] Harden xet cargo build against transient network failures by @pallasathena92 in #641
• [Docs] Fix Pages build: bump Hugo to 0.157.0 for Docsy v0.15.0 by @pallasathena92 in #642
• Bump autoprefixer from 10.4.23 to 10.5.0 in /site by @dependabot[bot] in #580
• [Core] Make explicit-runtime compat error to advisory event by @pallasathena92 in #643
• [Core] Add HuggingFace download timeout for replica agent by @XinyueZhang369 in #644
• Skip OCI Object Storage download for Ready same-path artifacts by @op109lvb in #629
• Skip same-path OCI reuse for download override by @op109lvb in #645
• [Bugfix] Grant controller-manager create on controllerrevisions by @pallasathena92 in #646
• [Docs] update docs for new features by @pallasathena92 in #648

Full Changelog: v1.0.0...v1.1.0