Skip to content

v0.4.0 -- final: teardown, region discovery, OAM IAM contract, strands-agent v1.16 and Backstage roll-up

Latest

Choose a tag to compare

@allamand allamand released this 06 Nov 18:29
· 25 commits to main since this release
f6eadfa

AWS App Modernization Blueprints — v0.4.0

v0.4.0 is the final release of the v0.4.0 line. It follows eight release candidates (v0.4.0-rc1 to v0.4.0-rc8) validated on full PEEKS workshop runs. Since rc8 it adds faster and cleaner teardown, AWS region discovery, a stricter OAM per-cluster IAM contract, the strands-agent v1.16 image pin, kubectl 1.37 compatibility for kind-crossplane, and Backstage fixes (Quick Links, no duplicated migration lock after an install restart).

Changes since v0.4.0-rc8

  • fix(oam): require global.clusterName for the per-cluster IAM names (#1258)
  • test(aiops-agent): argocd-status tool is on by default (v1 pinned) (#1260)
  • fix(workshop): wait for the AppmodService CRD and Backstage in Rust prewarms (#1272)
  • fix(destroy): faster hub addon teardown, sweep SG order, OIDC reaper (#1273)
  • chore(aiops-agent): pin strands-agent image v1.16 (OAP #138) (#1247)
  • fix(kind-crossplane): wait-for-providers JSONPath rejected by kubectl 1.37 (#1257)
  • fix(kind-kro-ack): check ACK credentials account (Fixes #1259) (#1262)
  • fix(workshop): don't race ESO on ArgoCD repo secrets in set-overlay-repo (#1267)
  • fix: discover the AWS region instead of defaulting to us-west-2 (#1266)
  • fix(destroy): kro/ACK DevLake wait, hub-side spoke discovery, phase markers (N-7) (#1265)
  • fix(backstage): Quick Links follow real service paths, add Langfuse (#1269)
  • fix(backstage): no duplicated migration lock after install restart (#1274)

v0.4.0 at a glance (since rc1)

  • Install: hub self-adoption pivot removes the permanent kind cluster (#1033); hub install returns sooner, with a bounded pivot and a background full-sync gate (#1053, #1098, #1084); start/done timing markers on every step (#1252); read-only post-install verification with task verify (#1207); AWS region discovery (#1266); ACK credentials account check (#1262); kubectl 1.37 compatibility (#1257).
  • Teardown / destroy: destroy leaves no orphans or app residue in AWS (#1174, #1217); the sweep reaps PVC volumes, ECR, DynamoDB, SSM and fluent-bit logs (#1240) and is scoped to this stack (#1062, #1113); faster hub addon teardown, sweep security-group ordering, an OIDC reaper and DevLake/spoke discovery fixes (#1273, #1265).
  • Backstage: waits for OIDC discovery (#1183); multi-arch image (#1161); readable template cards and correct defaults (#1179, #1223, #1244); Quick Links follow real paths (#1269); no duplicated migration lock after a restart (#1274).
  • CI/CD prewarm: Rust CI/CD pipeline and first image pre-created during install (#1136); Path A frontend and Rust dev deploy prewarmed (#1181, #1219); prewarms wait for their prerequisites (#1182, #1272); GitLab push webhooks to the Argo CD capability (#1226); DORA fixes (#1082, #1114, #1242).
  • Observability: Grafana/AMP seeding and Keycloak SAML converge (#1168); spokes found by their kro tags (#1203); Agent Overview dashboard fixes (#1245).
  • OAM / agents: service-rollout component and aws-service-identity trait; per-cluster OAM IAM names with a required global.clusterName (#1209, #1258); the aiops-agent ships off by default (#1155, #1204), with read-only RBAC (#1175), a read-only Argo CD status tool (#1243, #1246) and the strands-agent v1.16 image (#1247).
  • Workshop: Kargo bootstrap deadlock fixed (#1132) and Kargo chart 1.11.9 (#1212); Karpenter consolidation window (#1133); IDC handling with IDC_CONFIGURE_SKIP (#1083, #1101, #1099); NetworkPolicy on every cluster (#1241); Ray fixes (#1191, #1220, #1235).

Known issues / next patch

  • #1276 (open, release-priority): align the aiops-agent buildspec STRANDS_TAG with v1.16 and the OAP v0.1.0 notes. This affects only the image build script; the shipped chart already pins v1.16 (#1247). Planned for the next patch release.
  • #1256 (under review): install DAG that declares spokes early and runs CloudFront and the spoke apps in the background.
  • Carried from rc7, not re-verified for this tag: the ApplicationSet webhook returns HTTP 400 on the managed Argo CD capability, so the push-webhook path from #1226 does not yet trigger refreshes there.

Changes since rc8: v0.4.0-rc8...v0.4.0 (12 commits). The auto-generated list below covers the whole v0.4.0 cycle since v0.3.5.

What's Changed

  • feat(oam): service-rollout + aws-service-identity trait, deprecate appmod-service/dp-service-account by @shapirov103 in #950
  • fix(peeks): drop hardcoded 'peeks' prefix (Kargo git secret, Ray templates, AMP metrics secret) by @allamand in #952
  • feat(oam): add CUE sources and generator for kubevela definitions by @shapirov103 in #953
  • feat(abstractions): select Crossplane abstractions per cluster by label by @shapirov103 in #960
  • (fix): prefix DevLake identifiers per environment + adopt existing #949 by @zjaco13 in #959
  • fix(crossplane-base): GOGC=50 + GOMEMLIMIT, providers 1Gi/2Gi -> 320Mi/512Mi by @shapirov103 in #941
  • docs: Agents for Managing Platform on EKS — design by @allamand in #948
  • fix(kro): create the private route tables only once the NAT gateway is available (#1021) by @pnz1990 in #1030
  • fix(kro): gate AppmodService readiness on Rollout health (#977) by @pnz1990 in #1006
  • feat(aiops-agent): consolidated agent + agentic platform for PEEKS (validated e2e) by @allamand in #926
  • fix(cicd-pipeline): never inline the webhook payload into shell scripts (#987) by @pnz1990 in #1001
  • fix(cicd): authenticate the GitLab webhook with a per-pipeline secret token (#987) by @pnz1990 in #1002
  • fix(cicd): poll the rollout in one pod with pinned tools and GC DORA workflows (#984) by @pnz1990 in #1003
  • fix(cicd): CI update-git-repo rewrites deployment/dev/ only (#980) by @pnz1990 in #1004
  • fix(kro): let AppmodService Ingress traffic reach canary pods (#976) by @pnz1990 in #1007
  • fix(rust): add a stable rust-microservice Service to the kro templates (#974) by @pnz1990 in #1008
  • fix(backstage): use hub_cluster_name in cicd-pipeline template (#972) by @pnz1990 in #1009
  • fix(cicd-pipeline): stamp the real build time on CI images (#985) by @pnz1990 in #1010
  • fix(cicd): record prod deployments in DORA, label dev rollouts DEVELOPMENT (#981) by @pnz1990 in #1005
  • fix(observability): use scraper label names in Rust dashboard and KubeVela gates (#986) by @pnz1990 in #1011
  • fix(cicd): scope DORA seed IDs to the app and offset seeded PR keys (#983) by @pnz1990 in #1013
  • fix(cicd): stop kro pruning the EventSource's generated Service (#979) by @pnz1990 in #1014
  • fix(kro): keep CICDPipeline IAMRoleSelectors until their ACK resources are deleted (#973) by @pnz1990 in #1015
  • fix(kro): keep AppmodService IAMRoleSelectors until their ACK resources are deleted (#973) by @pnz1990 in #1016
  • fix(kro): restore AppmodService metrics analysis and Artillery gate (#978) by @pnz1990 in #1017
  • docs: fix the self-paced version check; point RELEASE_NOTES at GitHub Releases (#966) by @pnz1990 in #991
  • fix(workshop): keep idc:configure tolerant by default (#990) by @pnz1990 in #992
  • fix(cicd): date DORA deployments by the rollout, not the commit (#982) by @pnz1990 in #1012
  • fix(peeks): make AppmodService metrics gate resilient to AMP scrape timing (#957) by @allamand in #958
  • fix(cicd-pipeline): merge duplicate annotations so ECR repos keep adopt-or-create (#993) by @pnz1990 in #994
  • fix(ide): make open_when_ready reject URLs with an empty host (#971) by @pnz1990 in #995
  • fix(kro): delete ACK Table/Bucket before their IAMRoleSelector (#973) by @pnz1990 in #996
  • fix(idc): scope the provisioning Enable click and read the SCIM token from its dialog (#967) by @pnz1990 in #998
  • fix(workshop): derive the IDE SharedRole name from aggregated list-roles output (#970) by @pnz1990 in #999
  • fix(kro): create the /config ACK Secret after its source Secret (#968) by @pnz1990 in #1000
  • fix(workshop): default the spoke environment to dev when the name has no env keyword (#1018) by @pnz1990 in #1022
  • fix(workshop): spokes:disable-kro de-registers the spoke from Argo CD (#1019) by @pnz1990 in #1023
  • fix(workshop): add spokes:sweep-kro for what outlives a deleted KRO spoke (#1020) by @pnz1990 in #1024
  • fix(kro): let AppmodService enable either analysis gate on its own (#1025) by @pnz1990 in #1028
  • fix(cicd): fail and retry DORA setup when DevLake is unavailable (#1026) by @pnz1990 in #1029
  • fix(teardown): never sweep CloudFormation-owned security groups or IAM roles (#988, #989) by @pnz1990 in #1031
  • build(deps): bump next from 15.5.24 to 15.5.27 in /applications/next-js by @dependabot[bot] in #1037
  • fix(kro): scope AppmodService metrics queries to the cluster and the canary (#1027) by @pnz1990 in #1038
  • fix(java/kargo): use pod identity for ECR instead of a 12 h token (#1040) by @pnz1990 in #1041
  • fix(oam): scope KubeVela metric gate queries to the cluster and the canary (#1027) by @pnz1990 in #1044
  • fix(cicd-pipeline): keep the last 10 tagged images, expire untagged ones (#1039) by @pnz1990 in #1042
  • docs(agent-platform): align design with PR #926 (merge-gate, enable example, overlay basepath) by @allamand in #963
  • fix(kyverno): exempt platform namespaces from fail-closed webhook (#1035) by @allamand in #1036
  • fix(apps): drop the Rollout Services the AppmodService now creates (#1045) by @pnz1990 in #1047
  • fix(kro): let AppmodService own its Rollout Services again (#1045) by @pnz1990 in #1046
  • fix(kro): break Aurora RDS cluster/instance dependency deadlock by @hmuthusamy in #1049
  • feat(kind-kro-ack): hub self-adoption pivot — remove the permanent kind cluster (#775) by @allamand in #1033
  • fix(observability): bump aws-for-fluent-bit 3.4.13 -> 3.5.1 for opens… by @hmuthusamy in #1066
  • fix(kind-kro-ack): fill aws_argocd_url once the Argo CD capability exists (#1087) by @pnz1990 in #1089
  • fix(workshop): give the install's hub pivot only the time left in the install budget (#1074) by @pnz1990 in #1084
  • fix(kro): adopt existing EKS capabilities so the hub pivot gate can pass (#1070) by @pnz1990 in #1076
  • fix(kro): let a node drain past the CICDPipeline EventBus PDB (#1088) by @pnz1990 in #1090
  • fix(cicd): let the DORA setup's devlake-init converge on a re-run (#1071) by @pnz1990 in #1082
  • feat(kro): add enableGeneralPurposeNodePool toggle to EksCluster RGD by @allamand in #1056
  • perf(install): return hub install sooner — background the full-sync gate (kro-ack + crossplane) (lever #1) by @allamand in #1053
  • fix(workshop): drop the dead SSO token refresh from spokes:disable-kro (#1077) by @pnz1990 in #1081
  • fix(kro): GC wait-bucket retry pods on successful model download by @allamand in #1050
  • chore: bump EKS/Kubernetes version pin from 1.35 to 1.37 by @hmuthusamy in #1043
  • fix(backstage): point Ray serve template ZIP default at main by @allamand in #1048
  • fix(workshop): spokes:enable-crossplane keeps the other spokes' entries (#1067) by @pnz1990 in #1068
  • fix(teardown): only touch this stack's own scrapers, IDE-VPC SGs and EIPs (#1061) by @pnz1990 in #1062
  • fix(huggingface): give each stack its own model IAM role and policy names (#1069) by @pnz1990 in #1075
  • perf(cluster-providers): bounded Pod Identity readiness probe (replace sleep 90) [lever #4] by @allamand in #1058
  • chore(schema): make Kubernetes version required (no default) on kro RGD + Crossplane XRD by @allamand in #1097
  • fix(kro-ack): idempotent crossplane PIA bootstrap + jupyterhub duplic… by @hmuthusamy in #1065
  • feat(workshop): IDC_CONFIGURE_SKIP leaves IAM Identity Center alone (#1073) by @pnz1990 in #1083
  • fix(workshop): argocd-refresh-token honours IDC_CONFIGURE_SKIP (#1100) by @pnz1990 in #1101
  • fix(kind-kro-ack): remove multi-acct last, without a prune, in hub:destroy-addons (#1078) by @pnz1990 in #1102
  • fix(kind-kro-ack): destroy 6h never sweeps the IDE/hub VPC as a spoke VPC (#1106) by @pnz1990 in #1109
  • fix(workshop): spokes grant this stack's IDE SharedRole, not the first in the account (#1105) by @pnz1990 in #1108
  • fix(kind-kro-ack): keep Crossplane and kro's hub RBAC until the addons' AWS resources are deleted (#1107) by @pnz1990 in #1110
  • fix(sweep): cascade DevLake Aurora + subnet group in teardown by @allamand in #1051
  • fix(kind-kro-ack): keep the NodePools until the hub is deleted in hub:destroy-addons (#1085) by @pnz1990 in #1103
  • fix(kind-kro-ack): destroy step 6 reports a failed delete instead of ✓ (#1086) by @pnz1990 in #1104
  • fix(sweep): never sweep a stack whose prefix only starts with ours (#1111) by @pnz1990 in #1113
  • docs(destroy): spoke VPC sweep follow-ups from the #1109 review by @pnz1990 in #1117
  • fix(kind-kro-ack): idc:setup honours IDC_CONFIGURE_SKIP too (#1073) by @pnz1990 in #1099
  • fix(cicd): seed the DORA demo history once per webhook connection (#1092) by @pnz1990 in #1114
  • fix(spark-operator): bump controller+webhook CPU requests to 250m to clear exit-137 CrashLoop by @allamand in #1121
  • fix(crossplane-base): bump AWS provider family v2.6.1 -> v2.7.0 (Fix E) by @allamand in #1128
  • fix(grafana-dashboards): gate mysql-datasource behind devlake.enabled (Fix F) by @allamand in #1129
  • fix(platform): consolidation off ~23h/day on *-peeks, 1h daily window by @allamand in #1133
  • Fix stale ingress-nginx check in workshop validation helper by @allamand in #1127
  • Pre-pull artillery image for Module 30.5 performance gate by @allamand in #1126
  • fix(kargo): apply self-signed Issuer before webhook Certificates (negative sync-wave) by @allamand in #1132
  • chore: default clusterProvider to kind-kro-ack by @allamand in #1116
  • perf(workshop): cap hub:pivot at 900s, don't block install on vLLM by @allamand in #1098
  • fix(kiro): load appmod-blueprints and peeks agents on Kiro CLI v3 by @brunokktro in #1130
  • chore(backstage): point backstage_image at ghcr.io CNOE upstream image by @hmuthusamy in #1139
  • fix(workshop): correct KARGO_URL to /kargo and add LANGFUSE_URL by @hmuthusamy in #1146
  • fix(image-prepuller): move the artillery pre-pull out of the generic tree (#1137) by @allamand in #1138
  • fix(ci): handle quoted image: "<image>" placeholder in update-git-repo sed by @allamand in #1149
  • fix(cicd-pipeline): pin /<cluster_name> in dev/ CI sed (defense-in-depth) by @allamand in #1134
  • fix(platform): neutral fallback nodepool, decouple from workshop (#1095) by @allamand in #1096
  • feat(workshop): pre-warm Rust CI/CD pipeline + first image during install by @allamand in #1136
  • fix(java/kargo): run deploy-kargo.sh relative to its own dir by @allamand in #1154
  • fix(workshop): ship aiops-agent disabled by default by @allamand in #1155
  • fix(backstage): pin the multi-arch CNOE image by @hmuthusamy in #1161
  • docs(agent-platform): guardrail agent design + interlock enforcement decision by @allamand in #1160
  • docs(config): document the agenticRepo block (OAP addon coordinates) by @allamand in #1156
  • fix(lbc): apply self-signed Issuer before cert-manager Certificate by @allamand in #1164
  • fix(gitlab): disable Auto DevOps instance-wide before seeding projects by @allamand in #1165
  • fix(validation): don't leak strict mode from sourced backstage-auth.sh by @allamand in #1166
  • fix(argo-workflows): run argo-server with TLS so SSO keeps deep links by @allamand in #1163
  • fix(carm): kro-clusters owns spoke selectors; HTTPS ingress; install docs by @allamand in #1162
  • fix(backstage,kro-clusters): template kro key + fleet member, spoke provider default by @allamand in #1171
  • feat(bootstrap): opt-in per-hub spoke discovery by resource_prefix by @allamand in #1167
  • fix(kind-kro-ack): warn at install when no platformTags are set by @allamand in #1173
  • fix(bootstrap): addons overlay falls back to separate fleetRepoURL by @allamand in #1169
  • chore(lbc): note to re-check Issuer name on chart bump by @allamand in #1177
  • feat(ingress-class-alb): optional inboundCidrs allowlist by @allamand in #1170
  • fix(aiops-agent): build strands-agent from upstream OAP, pin v1.15 by @allamand in #1172
  • fix(observability): converge Grafana/AMP seeding and Keycloak SAML client by @allamand in #1168
  • fix(bootstrap): opt-in per-hub scoping for client-provisioner discovery by @allamand in #1178
  • fix(backstage): wait for OIDC discovery before starting backend by @allamand in #1183
  • fix(argocd): carry app syncOptions in injected .operation patches by @allamand in #1184
  • fix(crossplane-base): pull Functions from xpkg.upbound.io by @allamand in #1187
  • fix(kind-kro-ack): stop hub:claim heredoc executing backticks by @allamand in #1188
  • fix(keycloak,cicd): stop set -x from printing secrets to pod logs by @allamand in #1190
  • docs(alb-allowlist): require hub and OAP-spoke NAT egress IPs by @allamand in #1180
  • fix(workshop): make the prewarm Phase A join actually wait by @allamand in #1182
  • fix(backstage): readable EKS and Ray Service template cards by @allamand in #1179
  • docs(k8s-version): pin the Kubernetes version in the fleet-config overlay by @allamand in #1193
  • docs(kind-kro-ack): document KUBECONFIG constraints by @allamand in #1194
  • fix(kind-kro-ack): no passwords in urls output; destroy OIDC sweep scoped to this install by @allamand in #1195
  • feat(workshop): prewarm Path A frontend + Rust dev deploy (kro) by @allamand in #1181
  • feat(ingress-class-alb): auto-allow hub NAT egress in allowlist by @allamand in #1185
  • feat(external-dns): opt-in external_dns_domain_filters annotation by @allamand in #1189
  • feat(aiops-agent): read-only cluster-wide RBAC for autonomous RCA by @allamand in #1175
  • fix(cloudfront): wait for platform ALB, cap LBC/ingress retry backoff by @allamand in #1206
  • fix(addons): spoke addon fixes (cert-manager dev, fluentbit, external-dns) by @allamand in #1192
  • fix(ray): pre-staged HF models workshop-only + wait-bucket hygiene by @allamand in #1191
  • fix(jupyterhub): restore Keycloak OAuth endpoints and https callback by @allamand in #1205
  • fix(kind-kro-ack): destroy without orphans (hub VPC, RDS, logs) by @allamand in #1174
  • feat(aiops-agent): move registry entry upstream, off by default by @allamand in #1204
  • fix(observability): find spokes by their kro tags, not the workshop names by @allamand in #1203
  • fix(hub-pivot): declare publicAccessCIDRs so the adopted hub Cluster syncs by @allamand in #1216
  • fix(ray): give Ray Dashboard its own backend so ALB rewrite applies by @allamand in #1220
  • fix(workshop): pre-deploy Next.js frontend by default by @allamand in #1219
  • fix(kargo): bump chart 1.11.4 to 1.11.9 (logo 404 under the /kargo base path) by @allamand in #1212
  • chore(backstage): drop the duplicate static system-info entity by @allamand in #1213
  • fix(rust): retry first DynamoDB scan on Pod Identity race by @allamand in #1215
  • feat(verify): add read-only post-install verification (task verify) by @allamand in #1207
  • chore(deps): bump next from 15.5.27 to 15.5.28 in /applications/next-js by @dependabot[bot] in #1222
  • fix(backstage): default environment to dev in S3 templates by @allamand in #1223
  • feat(rust-app): add GET / route for the bare ingress prefix by @allamand in #1224
  • fix(ide): clearer open_when_ready message when the URL has no host by @allamand in #1225
  • docs(kro): day-2 re-push of a spoke config to Secrets Manager by @allamand in #1233
  • fix(bootstrap): drop empty core group in fleet-secrets ignoreDiffs by @allamand in #1232
  • fix(aiops-agent): honest Argo CD app sweep in the system prompt by @allamand in #1230
  • fix(kind-kro-ack): destroy leaves no app residue in AWS by @allamand in #1217
  • feat(workshop): GitLab push webhooks to the Argo CD capability by @allamand in #1226
  • fix(backstage): staging cluster uses the hub's upstream repos by @allamand in #1228
  • fix(client-provisioner): name objects per cluster, not env by @allamand in #1229
  • fix(appset-chart): keep per-cluster release names within 53 chars by @allamand in #1231
  • fix(next-js): pin nextjs-ui to multi-arch rebuild of main (fixes /unicorn _next/image 400) by @allamand in #1238
  • fix(aiops-agent): tear the KubeVela app down in dependency order by @allamand in #1237
  • fix(aiops-agent): size eks-read-mcp for parallel tool calls by @allamand in #1236
  • fix(ray): CPU text generation no longer returns empty text by @allamand in #1235
  • fix(kargo): prod stage also updates KubeVela publishVersion by @allamand in #1234
  • fix(sweep): reap and report PVC volumes, ECR, DynamoDB, SSM, fluent-bit logs (R-27) by @allamand in #1240
  • fix(oam): per-cluster IAM role and policy names for OAM apps by @allamand in #1209
  • feat(addons): enforce NetworkPolicy on every cluster (#1239) by @allamand in #1241
  • fix(cicd): skip DORA prod rollout check for non-pipeline images by @allamand in #1242
  • fix(backstage): template owner guest group, not user:guest by @allamand in #1244
  • fix(grafana-dashboards): regex namespace matchers in Agent Overview by @allamand in #1245
  • feat(install): start/done timing markers for every step by @allamand in #1252
  • fix(rg-eks): keep Argo CD capability policies; create after cluster ACTIVE by @allamand in #1254
  • feat(aiops-agent): read-only Argo CD app status tool (off until pinned) by @allamand in #1243
  • fix(oam): require global.clusterName for the per-cluster IAM names by @allamand in #1258
  • test(aiops-agent): argocd-status tool is on by default (v1 pinned) by @allamand in #1260
  • fix(workshop): wait for the AppmodService CRD and Backstage in Rust prewarms by @allamand in #1272
  • fix(destroy): faster hub addon teardown, sweep SG order, OIDC reaper by @allamand in #1273
  • chore(aiops-agent): pin strands-agent image v1.16 (OAP #138) by @allamand in #1247
  • fix(kind-crossplane): wait-for-providers JSONPath rejected by kubectl 1.37 by @allamand in #1257
  • fix(kind-kro-ack): check ACK credentials account (Fixes #1259) by @allamand in #1262
  • fix(workshop): don't race ESO on ArgoCD repo secrets in set-overlay-repo by @allamand in #1267
  • fix: discover the AWS region instead of defaulting to us-west-2 by @allamand in #1266
  • fix(destroy): kro/ACK DevLake wait, hub-side spoke discovery, phase markers (N-7) by @allamand in #1265
  • fix(backstage): Quick Links follow real service paths, add Langfuse by @allamand in #1269
  • fix(backstage): no duplicated migration lock after install restart by @allamand in #1274

New Contributors

Full Changelog: v0.3.5...v0.4.0