v0.80.2

Attention!

Notable changes in this release:

• The control-plane nodes' taint has been changed from node-role.kubernetes.io/master to node-role.kubernetes.io/control-plane, requiring users to update tolerations in their applications to schedule pods on these nodes. Example:

tolerations:
- key: node-role.kubernetes.io/control-plane
  operator: "Exists"
  effect: NoSchedule

• Use the new AzureDisk CSI Driver v1.29.1 for k8s v1.28+. Use AzureDisk CSI Driver v1.28.3 for k8s v1.27. Use AzureDisk CSI Driver v1.26.5 for k8s v1.26.
  • See Azure Disk CSI Driver: Version Mapping for more details.
• Upgraded to runc version 1.1.12 to address CVE-2024-21626 vulnerability.

v0.80.2 - 2024-02-06

Maintenance 🔧

• update Linux and Windows VHDs for February 2024 (#230)
• update containerd version to 1.6.28 and runc version to 1.1.12 (#229)
• support Kubernetes v1.27.10 and 1.28.6 (#228)

Please report any issues here: https://github.com/Azure/aks-engine-azurestack/issues/new

v0.80.1 - 2024-01-24

Maintenance 🔧

• Replace taint node-role.kubernetes.io/master to node-role.kubernetes.io/control-plane (#225)

Please report any issues here: https://github.com/Azure/aks-engine-azurestack/issues/new

v0.80.0 - 2024-01-19

Build 🏭

• deps: bump golang.org/x/crypto from 0.14.0 to 0.17.0 (#213)
• deps: bump golang.org/x/crypto from 0.14.0 to 0.17.0 in /test/e2e (#212)

Documentation 📘

• Azure Stack Hub doc update for v0.79.0 (#208)

Maintenance 🔧

• update Linux and Windows VHDs for January 2024 (#222)
• remove unsupported feature gates for kubelet config in master and agent profile. (#220)
• include Windows Server December 2023 patches (#219)
• support CSI driver 1.29.1 for k8s 1.28 (#218)
• support Kubernetes v1.28.5 and 1.27.9 (#217)
• remove invalid k8s v1.28 flags and feature gates (#216)

Please report any issues here: https://github.com/Azure/aks-engine-azurestack/issues/new

v0.80.1

Attention!

Notable changes in this release:

• The control-plane nodes' taint has been changed from node-role.kubernetes.io/master to node-role.kubernetes.io/control-plane, requiring users to update tolerations in their applications to schedule pods on these nodes. Example:

tolerations:
- key: node-role.kubernetes.io/control-plane
  operator: "Exists"
  effect: NoSchedule

• Use the new AzureDisk CSI Driver v1.29.1 for k8s v1.28+. Use AzureDisk CSI Driver v1.28.3 for k8s v1.27. Use AzureDisk CSI Driver v1.26.5 for k8s v1.26.
  • See Azure Disk CSI Driver: Version Mapping for more details.

v0.80.1 - 2024-01-24

Maintenance 🔧

• Replace taint node-role.kubernetes.io/master to node-role.kubernetes.io/control-plane (#225)

Please report any issues here: https://github.com/Azure/aks-engine-azurestack/issues/new

v0.80.0 - 2024-01-19

Build 🏭

• deps: bump golang.org/x/crypto from 0.14.0 to 0.17.0 (#213)
• deps: bump golang.org/x/crypto from 0.14.0 to 0.17.0 in /test/e2e (#212)

Documentation 📘

• Azure Stack Hub doc update for v0.79.0 (#208)

Maintenance 🔧

• update Linux and Windows VHDs for January 2024 (#222)
• remove unsupported feature gates for kubelet config in master and agent profile. (#220)
• include Windows Server December 2023 patches (#219)
• support CSI driver 1.29.1 for k8s 1.28 (#218)
• support Kubernetes v1.28.5 and 1.27.9 (#217)
• remove invalid k8s v1.28 flags and feature gates (#216)

Please report any issues here: https://github.com/Azure/aks-engine-azurestack/issues/new

v0.80.0

v0.80.0 - 2024-01-19

Build 🏭

• deps: bump golang.org/x/crypto from 0.14.0 to 0.17.0 (#213)
• deps: bump golang.org/x/crypto from 0.14.0 to 0.17.0 in /test/e2e (#212)

Documentation 📘

• Azure Stack Hub doc update for v0.79.0 (#208)

Maintenance 🔧

• update Linux and Windows VHDs for Janurary 2024 (#222)
• remove unsupported feature gates for kubelet config in master and agent profile. (#220)
• include Windows Server December 2023 patches (#219)
• support CSI driver 1.29.1 for k8s 1.28 (#218)
• support Kubernetes v1.28.5 and 1.27.9 (#217)
• remove invalid k8s v1.28 flags and feature gates (#216)

Please report any issues here: https://github.com/Azure/aks-engine-azurestack/issues/new

v0.79.0

v0.79.0 - 2023-10-23

Attention!

Notable changes in this release:

• The --seccomp-default flag is now automatically enabled for each node in the cluster.
  • See Seccomp Profile for more details.
• Kubernetes v1.27+ no longer auto generates service account token secrets for ServiceAccounts.
  • See Service account token secrets for more details.
• MTU is set to 1500 (instead of 1350) for Kubenet CNI (#192)
• Fixed aks-engine-azurestack rotate-certs command (#204)
• Use the new AzureDisk CSI Driver v1.28.3 for k8s v1.27+. Use AzureDisk CSI Driver v1.26.5 for k8s v1.26.
  • See Azure Disk CSI Driver: Version Mapping for more details.

Bug Fixes 🐞

• shorten custom data in cloud init files and azure disk csi driver addon (#205)
• remove LegacyServiceAccountTokenNoAutoGeneration for k8s v1.27 (#200)
• Remove unused bridge network (#183)

Build 🏭

• deps: bump golang.org/x/net from 0.10.0 to 0.17.0 (#199)
• deps: bump golang.org/x/net from 0.10.0 to 0.17.0 in /test/e2e (#198)

Documentation 📘

• clarify cluster-autoscaler support on Azure Stack Hub (#202)
• Add seccomp profile, csi driver, and dualstack documentation (#196)
• Azure Stack Hub doc update for v0.78.0 (#189)

Features 🌈

• Enable seccomp profile defaulting (#193)

Maintenance 🔧

• update Linux and Windows VHDs for October 2023 (#206)
• rotate-certs creates its own known_hosts copy (#204)
• include Windows Server October 2023 patches (#203)
• support Kubernetes v1.27.6 (#195)
• remove invalid k8s v1.27 flags and feature gates (#197)
• support Kubernetes v1.26.9 (#194)
• set MTU to 1500 for the kubenet CNI (#192)
• upgrade azuredisk csi driver to v1.28.3 (#190)
• new Windows signed scripts and package version (#176)

Testing 💚

• e2e validates Windows HostProcess pods (#182)

Please report any issues here: https://github.com/Azure/aks-engine-azurestack/issues/new

v0.78.0

v0.78.0 - 2023-09-06

Documentation 📘

• Azure Stack Hub doc update for v0.77.0 (#173)

Maintenance 🔧

• update Linux and Windows VHDs for August 2023 (#181)
• include Windows Server August 2023 patches (#180)
• upgrade Windows csi-proxy to v1.1.3 (#179)
• support Kubernetes v1.26.8 (#178)
• support Kubernetes v1.25.13 (#177)
• remove AKS billing extension (#174)

Please report any issues here: https://github.com/Azure/aks-engine-azurestack/issues/new

v0.77.0

v0.77.0 - 2023-07-26

Bug Fixes 🐞

• update WindowsContainerdURL during upgrade and scale (#167)
• disable powershell progress bar during ssh to collect windows logs (#166)
• stop collecting docker engine logs for Windows nodes (#153)
• upgrade azure network policy manager to v1.4.32 (#151)
• persist runUnattendedUpgradesOnBootstrap (#142)
• addpool generates prefixes based on pool count (#138)

Build 🏭

• produce cgmanifest.json per UbuntuVHD build (#156)

Continuous Integration 💜

• use cloud controller manager in disconnected pipeline (#165)
• fix choco package release action (#137)

Documentation 📘

• how to rotate spn credentials (#163)
• how to renew front-proxy certs (#157)
• Azure Stack Hub doc update for v0.76.0 (#133)

Features 🌈

• DISA Kubernetes STIG compliance (#143)

Maintenance 🔧

• update Linux and Windows VHDs for July 2023 (#170)
• upgrade CSI snapshot to v5.0.1, get node info from labels, disable zones support (#164)
• Update Windows VHD packer job to use July 2023 patches (#162)
• upgrade azuredisk-csi-driver v1.26.5 components (#161)
• support Kubernetes v1.26.6 (#160)
• upgrade containerd to v1.6.21 and runc to v1.1.7 (#159)
• upgrade azuredisk-csi-driver to v1.26.5 (#158)
• remove private preview warning for AzureCNI (#155)
• update ip-masq-agent security context (#144)
• fix Windows VHD version for April 2023 (#131)

Security Fix 🛡️

• use of insecure HostKeyCallback implementation (#149)
• incorrect conversion between integer types (#147)
• create CodeQL action (#145)

Testing 💚

• E2E suite pulls busybox from MCR (#154)

Please report any issues here: https://github.com/Azure/aks-engine-azurestack/issues/new

v0.76.0

v0.76.0 - 2023-04-26

Bug Fixes 🐞

• enableUnattendedUpgrades not honored (#124)
• shorten custom data in cloud init files (#121)
• add kube-addon-manager v9.1.6 to vhd (#118)
• remove invalid k8s v1.24 flags (#114)
• use cross-platform pause image as the containerd sandbox image on Windows (#106)
• enforce each addon manager pod (#99)
• kubernetes-azurestack.json uses distro aks-ubuntu-20.04 (#87)
• get-akse.sh pulls using the correct file name (#84)

Documentation 📘

• clarify that the "azuredisk-csi-driver" addon works now on both Linux and Windows nodes (#96)

Continuous Integration 💜

• call test-vhd-no-egress from release github workflow (#123)
• exclude version control information from test binary (#122)
• Add -buildvcs=false for go build (#120)
• call test-vhd-no-egress github workflow from create-release-branch (#119)
• add no-egress GitHub action (#108)
• release workflow tags the correct commit (#113)
• gen-release-changelog wf creates branch and commit (#112)
• update actions/checkout to v3 (#111)
• chocolatey workflow (#86)
• release workflows run no-egress scenarios (#85)

Features 🌈

• get-logs collects etcd metrics (#126)
• add support for Kubernetes v1.24.11 (#109)
• migrate from Pod Security Policy to Pod Security admission (#94)
• DISA Ubuntu 20.04 STIG compliance (#83)

Maintenance 🔧

• update Linux and Windows VHDs for April 2023 (#129)
• Update Windows VHD packer job to use Apr 2023 patches (#127)
• update go-dev image to v1.36.2 (#128)
• update Linux and Windows VHDs for March 2023 (#115)
• support Kubernetes v1.25.7 (#105)
• upgrade coredns to v1.9.4 (#98)
• replace usage of deprecated "io/ioutil" golang package (#97)
• upgrade containerd to 1.5.16 (#95)
• upgrade pause to v3.8 (#93)
• update golang toolchain to v1.19 (#90)
• update registries for nvidia and k8s.io components (#88)
• remove package apache2-utils from VHD (#82)

Security Fix 🛡️

• bump x/net and x/crypto (#104)

Testing 💚

• remove auditd from packages validate script (#116)
• e2e suite validates an existing PV works after a cluster upgrade (#92)

Please report any issues here: https://github.com/Azure/aks-engine-azurestack/issues/new

v0.75.4

v0.75.4 - 2023-03-09

Bug Fixes 🐞

• kubernetes-azurestack.json uses distro aks-ubuntu-20.04 (#87)
• use cross-platform pause image as the containerd sandbox image on Windows (#106)

Continuous Integration 💜

• release workflow creates pre-release
• release workflows run no-egress scenarios (#85)

Documentation 📘

• Enable azurestack-csi-driver addon for mixed clusters (#96)
• Azure Stack Hub doc update for v0.75.3 (#81)

Testing 💚

• e2e suite validates an existing PV works after a cluster upgrade (#92)

Please report any issues here: https://github.com/Azure/aks-engine-azurestack/issues/new

v0.75.3

[v0.75.3] - 2023-02-03

Attention!

AKS Engine release v0.75.3, and all future AKS Engine releases on Azure Stack Hub, will be from the new Azure/aks-engine-azurestack repository. As such, all aks-engine commands should be replaced with aks-engine-azurestack. Please create an issue in the new repository if you find any. 

AKS Engine release v0.75.3 on Azure Stack Hub includes a new Ubuntu 20.04-LTS VHD distro to use in either your control plane and/or worker node pools. Starting from this release, Ubuntu 18.04 will no longer be supported. Please refer to the section Upgrading Kubernetes clusters created with the Ubuntu 18.04 Distro for more details. 

Starting from Kubernetes v1.24, only the containerd runtime is supported. Please refer to the section Upgrading Kubernetes clusters created with docker runtime for more details. For AKS Engine release v0.75.3, clusters with Windows nodes on Kubernetes v1.23 can use the Windows base image with Docker runtime. Clusters with Windows nodes on Kubernetes v1.24 can use the Windows base image with Containerd runtime.

Bug Fixes 🐞

• CoreDNS image not updated after cluster upgrade (#75)
• change reference of cni config to scripts dir (#71)
• add Azure CNI config script to Ubuntu VHD (#70)
• unit test checking e2e configs (#49)
• syntax error in Windows VHD script (#41)
• ensure eth0 addr is set to NIC's primary addr (#39)

Continuous Integration 💜

• remove no-egress job from create branch action (#79)
• PR gate runs E2E suite (#69)
• PR checks consume SIG images (#64)
• E2E PR check uses user assigned identity (#54)
• fix variable name in e2e PR check (#52)
• e2e PR check sets tenant (#51)
• e2e PR check does not use AvailabilitySets (#47)
• e2e PR check does not use custom VNET (#46)
• e2e PR check does not use MSI (#45)

Documentation 📘

• remove Azure as a target cloud (#43)
• rename binary name in all markdown files (#42)

Maintenance 🔧

• update default windows image to jan 2023 (#77)
• Update Windows VHD packer job to use Jan 2023 patches (#76)
• change base image sku and version to azurestack (#74)
• set fsType to ext4 in supported storage classes (#73)
• enable v1.23.15 & v1.24.9, use ubuntu 20.04 as default, force containerd runtime (#68)
• include relevant updates from v0.75.0 (#56)
• include relevant updates from v0.74.0 (#55)
• include relevant updates from v0.73.0 (#53)
• remove kv-fluxvolume addon (#48)
• prefer ADO for PR E2E check (#38)
• added e2e to PR workflow (#36)

Testing 💚

• e2e sets ImageRef in all linux nodepools (#65)

Please report any issues here: https://github.com/Azure/aks-engine-azurestack/issues/new