Repository navigation
What's Changed
Key New Features 🎉
- feat(cli): add gcluster explain command for blueprint and module discovery by @arpit974 in #6538
- feat(examples): add large-scale GKE blueprints and deployment guide by @shubpal07 in #6471
- feat(gke-node-pool): pin node pools to reservation sub-blocks by @vikramvs-gg in #6566
- feat(catalog): generate llms.txt, llms-full.txt, and complete repo README indexes by @arpit974 in #6580
- feat(job): add --pathways-deploy-sps flag to deploy SPS instances using gcluster job submit by @agrawalkhushi18 in #6562
- [Slurm on TPU] Add Slurm support for TPU v5e, v5p, and v6e by @AdarshK15 in #6522
Module Improvements 🔨
- perf(slurm-gcp-v6): load and write config.yaml with libyaml by @nikosavola in #6483
- Add node_image_config for GKE custom node images by @vikramvs-gg in #6463
- feat(gke-node-pool): support ignore_node_count_changes for external resizes by @SwarnaBharathiMantena in #6551
- fix(gke): suppress cluster and node-pool drift in lifecycle ignore_changes by @SwarnaBharathiMantena in #6547
- Add support for max_retry_count and lifecycle_policies to batch-job-template module by @jacobw125 in #6435
Improvements 🛠
- fix(ofe): fix eight cluster-deployment sub-issues by @ep-nag in #6322
- feat(kubectl-apply): expose Kueue wait_for_pods_ready config and default recovery_timeout to 0s on Pathways by @agrawalkhushi18 in #6506
- slurm-gcp-v6: compute zone deny list in the controller by @nikosavola in #6434
- fix(version): Fix release tag placement and enable CI tag overrides in Makefile by @ishitachail in #6460
- feat(mtc): wire enable_multi_tier_checkpointing to kubectl-apply and remove install knob by @Neelabh94 in #6548
- feat(examples): add EDA Slurm blueprint and workload examples for GCD by @juntangc in #6455
- Deduplicate kubectl readiness reads during GKE job submit by @sudheer-quad in #6485
- fix(shell): default PromptYesNo to no on EOF or read error by @Neelabh94 in #6553
- feat(job): inject default MASTER_ADDR and WORKERS_0_HOSTNAME for GKE JobSet workloads by @Neelabh94 in #6534
- feat: enhance metadata validators and add storage/GKE node pool checks by @shubpal07 in #6584
- Support IBM Spectrum Symphony in Cluster Toolkit for GCE and GKE. by @jrossthomson in #6256
- feat(validators): validate module-level and GKE affinity reservations by @shubpal07 in #6591
- feat(config): suggest module use wiring for missing inputs and require private-service-access use by @shubpal07 in #6564
- feat(guardrails): mark generated HCL as DO NOT EDIT, hint blueprint fixes on deploy failure, and add --live skill evals by @saara-tyagi27 in #6587
- feat(engine): support reconfigure_ignores via native Terraform override generation by @SwarnaBharathiMantena in #6589
Version Updates ⏫
- feat(network/firewall-rules): upgrade CFT network firewall-rules to v18.3+ by @SwarnaBharathiMantena in #6498
- feat(network/vpc): upgrade CFT network to v18.3+, address to v5.1+, and cloud-router to v9.1+ by @SwarnaBharathiMantena in #6494
- feat(network/gpu-rdma-vpc): upgrade CFT network to v18.3+ by @SwarnaBharathiMantena in #6496
- feat(modules): upgrade CFT service-accounts to v5.1+, vm to v15.4+, and kubernetes-engine to v46.0+ by @agrawalkhushi18 in #6521
Bug fixes 🐞
- fix(kubectl-apply): only render Kueue and asapd-lite config when installed by @Neelabh94 in #6503
- fix(job): check Artifact Registry and Docker credentials only for Crane builds by @Neelabh94 in #6488
- fix(cloud-build): invoke cloud_build.sh with bash in local-exec by @hamadfadi in #6487
- fix(gcs-sync): invoke stage_to_gcs.sh with /bin/bash in local-exec by @hamadfadi in #6486
- fix(gke-cluster): default master_ipv4_cidr_block to null to avoid subnet CIDR collision by @Neelabh94 in #6523
- fix(job): use hostname exclusive-topology for single-node slices by @Neelabh94 in #6526
- fix(job): set explicit CPU and memory requests on pathways-proxy and pathways-rm by @Neelabh94 in #6527
- fix(job): default --pathways-max-slice-restarts to 0 when --pathways-elastic-slices is 0 by @Neelabh94 in #6528
- fix(mtc): direct WI, driver tolerations and worker-only Pathways volumes by @Neelabh94 in #6504
- fix(tutorials): update hpc-slurm-qwiklabs.yaml n2d machine types to e2 and enable slurm auth by @WyattGorman in #6482
- feat(gke): fail fast on invalid MTC CLI flags before cluster calls by @Neelabh94 in #6513
- fix(colab): make GCS mount post-startup script POSIX-sh compatible and idempotent across runtime restarts by @hamadfadi in #6500
- feat(mtc): verify driver compatibility/readiness and replace CR on changes by @Neelabh94 in #6514
- fix(gke): wait for existing JobSet webhook instead of re-applying manifests by @Neelabh94 in #6554
- fix(job/pathways): pass --sidecar_name=external to pathways-proxy when the colocated Python sidecar is enabled by @agrawalkhushi18 in #6593
New Contributors
- @ctk-pr-bot made their first contribution in #6520
Full Changelog: v1.107.0...v1.108.0