XMC Release Notes 0.11.0

XMC Release Notes (Week of September 14 – September 18, 2026)

📌 Release Summary & SemVer Determination

• Analysis Window: 2026-09-14T00:00:00Z to 2026-09-18T13:48:53Z
• Total Merged Pull Requests: 40 PRs (100% accounted for & verified)
• Recommended Version Bump: Minor Bump (0.Y.0 / X.Y.0)
  • Reasoning: Introduces backwards-compatible user and operator capabilities (out-of-the-box work unit artifacts navigation in the UI, General Availability of Queue Predictability throughput metrics, automatic Managed XProf metadata defaulting, Actuator JobSet adoption idempotency), standardizes deployment configuration switches in CTK v2 and modern Kueue v1beta2 manifests, and lays the foundational backend architecture for upcoming Pause Scheduling preview capabilities without breaking existing APIs or data contracts.

---

Section 1: 🌟 Public Changes (Available Out-of-the-Box)

🚀 Major Highlights & Promoted Capabilities

• Work-Unit Artifact Exploration Enabled by Default: Researchers and developers can now immediately inspect and navigate diagnostic artifacts generated by individual work units directly on the per-experiment page without requiring manual feature flag activation (#875).
• Resource Observability Queue Predictability Graduated to GA: Removed the temporary "Work in Progress" banner from the Predictability section on Resource Observability queue cards, delivering production-ready queue velocity and throughput predictability metrics directly to cluster operators (#921).
• Automatic Metadata Defaulting for Managed XProf Artifacts: The Experiment Storage Service (ESS) CreateArtifact API now automatically populates display_name and run_group with sensible defaults when omitted by client training workloads, streamlining artifact registration (#867).

✨ New Features & User-Facing Improvements

• Deterministic MLRun Identifier Generation: The reconciler now generates MLRun IDs using deterministic truncated SHA-256 hashes of parent experiment and work unit identifiers, eliminating ID collisions and race conditions during reconciler retries or failovers (#865).
• Contextual Work Unit Profiler Tooltips: Added explanatory tooltips to the "Profile" button within the work units table to provide operators with immediate clarity regarding profiling availability and active states (#872).

🐛 User-Facing Bug Fixes & Stability

• Actuator JobSet Creation Idempotency: Actuator now idempotently reconciles and adopts existing Kubernetes JobSet resources when encountering AlreadyExists errors (such as after network timeout retries during submission), preventing unnecessary workload execution failures (#861).
• OCI Container Startup & Security Hardening: Granted explicit read and execute permissions to the entrypoint script and Nginx configuration inside UI OCI images, ensuring reliable container startup in non-root and security-hardened environments (#886).

---

Section 2: 🚀 Production-Ready Features Behind Feature Flags (Safe to Enable)

1. Cluster Toolkit (CTK) v2 Blueprint Feature Switches

• Configuration Toggle:
  • Cluster Toolkit Blueprint: Documented and exposed formal deployment configuration switches in the CTK v2 blueprint (deploy/ctk_v2/xmanager-cloud.yaml and README.md), allowing operators to configure optional platform modules such as the Resource Observability Dashboard (#896).
• Customer Value & Capabilities:
  • Gives platform engineers clear, declarative controls to selectively activate or deactivate peripheral observability stacks and services during initial cluster blueprint provisioning.
• Associated PRs: #896.

2. Kueue Resource Version Standardization (v1beta2)

• Configuration Toggle:
  • Helm Chart: Standardized all Kueue queue manifests across CPU, GPU, and TPU queues in deploy/helm/templates/kueue-dev/ to serve kueue.x-k8s.io/v1beta2 (#915).
• Customer Value & Capabilities:
  • Aligns local and remote deployment templates with modern Kueue Custom Resource Definition storage versions, eliminating runtime object conversion overhead and future-proofing queue definitions for cluster upgrades.
• Associated PRs: #915.

---

Section 3: 🚧 In-Progress Development

Warning

The following changes lay the initial backend foundation and scaffolding for the upcoming Pause Scheduling capability. These components are strictly for internal development, are currently non-functional/incomplete, and are not yet available for customer or preview enablement.

Pause Scheduling Groundwork (Work-in-Progress)

• Status: In-development backend scaffolding (internal dev flag pause_scheduling_enabled: false default in Helm) (#850, #879).

• Work Merged This Cycle:

  • Admin UI Scaffolding: Added draft administrative card and confirmation modal components to the Admin Panel (#889, #891).
  • Health Service Endpoints & Messaging: Added preliminary :pause/:resume endpoints and Redis notification broadcast hooks (#877, #894, #920).
  • Actuator State Handling: Added initial stream listeners and local state cache interfaces (#912).
  • ESS Resumption Interfaces: Implemented base consumer worker interfaces and persistence repository structures (#857, #876, #890).

• Associated PRs: #850, #857, #876, #877, #879, #889, #890, #891, #894, #912, #920.

---

Section 4: ⚙️ Operational, Infrastructure & Engineering Velocity

⚙️ Operational & CI/CD Infrastructure Updates

• Automated Nightly Verification & Issue Dispatch: Added scheduled nightly test workflow automation with automated GitHub Issue alerts dispatched to repository maintainers upon failure (#852, #884, #888).
• Parallel Workload Execution in Nightly CI: Added parallel example workload execution runner and unified nightly examples E2E pipeline (#881, #909).
• Atomic Workload Launch & Validation: Consolidated workload launch and verification into an atomic CI runner pattern, eliminating legacy standalone trigger jobs (#895, #919).
• Nightly Dashboard Deployment & Version Tagging: Enabled dashboard service deployment in nightly build and GKE deploy workflows with run-number version tagging upfront (nightly-YYYY-MM-DD.<run_number>) (#893, #918).

🛠️ Developer Velocity & Testing Infrastructure

• E2E Test Orchestration Hardening: Hardened E2E test orchestration foundation, headless Dex OIDC authentication helpers, Playwright authenticator, dynamic KinD binary resolution, UI screenshot diagnostics, and dev NodePort forwarding manifests (#746).
• Unified Verification Framework: Introduced common entity verification framework, queue/state resilience assertions, reusable in-process runner harness, and exhaustive Protobuf/priority validation CLI (tools/nightly_tests/) (#862, #868, #873, #882, #901, #908).
• Examples & Architecture Documentation:
  • Standardized requirements.txt across all example workloads and simplified programmatic XProf profiler setup (#866, #880).
  • Documented architecture and injected environment variables for XMC managed XProf integration in docs/architecture/managed_xprof.md (#871).
• Repository Hygiene: Updated developer availability schedule in .agents/absence.yaml (#870).