Skip to content

v0.18.0

Latest
Latest

Choose a tag to compare

View all tags
@github-actions github-actions released this 23 Jul 17:55
Immutable release. Only release title and notes can be modified.
v0.18.0
This tag was signed with the committer’s verified signature.
mchmarny Mark Chmarny
SSH Key Fingerprint: GvwYDxrKzpkXGzFjtmQ26NvM9ij3PeD/qnNvBmT67zE
Verified
Learn about vigilant mode.
1439f2f
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

This release focuses on expanded Slurm-on-Kubernetes support, air-gapped signing and verification, parallel bundle deployment, and first-class GPU driver ownership.

Highlights

Slurm on Kubernetes

  • AKS H100 Slinky/Slurm recipe with Enroot/Pyxis support and Gres/GPU configuration
  • New topograph component with the slinky engine for topology-aware scheduling
  • Snapshot support for Slinky Slurm and the MariaDB operator
  • Functional Kueue with default quota CRs

Recipes & Coverage

  • Kubeflow training overlay for RTX PRO 6000 on EKS, plus RTX PRO 6000 inference (Dynamo) evidence
  • VR200 training and inference (Dynamo) recipe evidence on RKE2
  • AKS H100 driver-only and managed-driver recipe evidence
  • Recipe resolution now enforces stated-criteria coverage, failing fast when a recipe cannot satisfy its declared criteria

Air-Gapped Supply Chain - Bundles can now be signed and verified entirely offline: aicr bundle accepts --tlog-upload=false to skip transparency-log upload, and verification gains --insecure-ignore-tlog for disconnected environments. KMS-backed signing also adds HashiCorp Vault support. Verification also got stricter - bundles now verify as fully self-contained, air-gapped artifacts, recipe.yaml is covered by bundle checksums, and AICR now runs its own Rekor v2 identity monitoring for the release signer.

Parallel Deployment - The deployer now deploys independent components in parallel, following the dependency graph so unrelated components no longer wait on each other.

GPU Driver Ownership - Driver management is now an explicit contract: recipes auto-detect a pre-installed GPU driver from the snapshot, AKS defaults to the Azure-managed GPU driver profile, and a bundle-time coherence check catches conflicting driver-ownership configuration before deploy.

Validation & Evidence - The validator gains a configurable inference-perf router mode, recipe-supplied NCCL benchmark runtime via --data, a uniform-RDMA-fabric readiness gate, GPU readiness gated on runtime-required taint clearance, and fail-fast on degraded GPU nodes. The evidence dashboard at validation.aicr.run gains a cross-version combined view with deep links from recipe health.

Other Improvements

  • SDK supports custom kubeconfig paths for validation jobs, and aicr validate --kubeconfig now selects the target cluster end-to-end
  • aicr diff compares structured snapshot fields
  • GPU Operator upgraded to v26.3.3 with driver 580.173.02; nvidia-tuned bumped to 0.3.2
  • AICR container images are now based on nvcr.io/nvidia/distroless/static

Thanks to @ArangoGutierrez, @atif1996, @ayuskauskas, @kaynetu, @lockwobr, @mohityadav8, @njhensley, @tjrasche, @xdu31, @yuanchen8911, and @mchmarny.

Changelog

New Features

Bug Fixes

Other Tasks

Contributors

mchmarny, lockwobr, and 10 other contributors
Assets 16
Loading