From c4ade4e5820cd9f3e8d26d6640da04fdff33b9c6 Mon Sep 17 00:00:00 2001 From: Mathew Wicks Date: Tue, 29 Aug 2023 00:03:48 -0700 Subject: [PATCH] chore: release 8.8.0 (#778) Signed-off-by: Mathew Wicks --- charts/airflow/CHANGELOG.md | 36 ++++++++++++++----- charts/airflow/Chart.yaml | 4 +-- charts/airflow/README.md | 23 ++++++------ .../docs/faq/configuration/airflow-plugins.md | 4 +-- .../configuration/extra-python-packages.md | 4 +-- .../docs/faq/dags/load-dag-definitions.md | 4 +-- .../examples/google-gke/custom-values.yaml | 2 +- .../examples/minikube/custom-values.yaml | 2 +- .../airflow/sample-values-CeleryExecutor.yaml | 2 +- ...ample-values-CeleryKubernetesExecutor.yaml | 2 +- .../sample-values-KubernetesExecutor.yaml | 2 +- charts/airflow/values.yaml | 2 +- 12 files changed, 54 insertions(+), 33 deletions(-) diff --git a/charts/airflow/CHANGELOG.md b/charts/airflow/CHANGELOG.md index fe5493bf..c416b875 100644 --- a/charts/airflow/CHANGELOG.md +++ b/charts/airflow/CHANGELOG.md @@ -8,9 +8,34 @@ This project follows [Semantic Versioning](https://semver.org/spec/v2.0.0.html) TBD +## [8.8.0] - 2023-08-28 + +> 🟨 __NOTES__ 🟨 +> +> - the default airflow image is now `apache/airflow:2.6.3-python3.9`, but you can still use any supported version of airflow, see the [airflow version support matrix](https://github.com/airflow-helm/charts/tree/main/charts/airflow#airflow-version-support) +> - this is the first version of the chart with support for airflow 2.7, along with pretty much all previous versions of airflow, see the [airflow version support matrix](https://github.com/airflow-helm/charts/tree/main/charts/airflow#airflow-version-support) + +> 🟦 __OTHER__ 🟦 +> +> - If you appreciate the `User-Community Airflow Helm Chart` please consider supporting us! +> - [give a ⭐ on GitHub](https://github.com/airflow-helm/charts/stargazers) +> - [give a ⭐ on ArtifactHub](https://artifacthub.io/packages/helm/airflow-helm/airflow) + +### Changed +- the default airflow image is now `apache/airflow:2.6.3-python3.9` (see the [airflow version support matrix](https://github.com/airflow-helm/charts/tree/main/charts/airflow#airflow-version-support)) + +### Added +- add liveness probe for celery workers ([#766](https://github.com/airflow-helm/charts/pull/766)) +- support `include_deferred` in pool sync for airflow 2.7.0 ([#775](https://github.com/airflow-helm/charts/pull/775)) + +### Fixed + +- sync-users for airflow 2.7.0 ([#772](https://github.com/airflow-helm/charts/pull/772)) +- invalid pgbouncer-certs volume spec when empty ([#777](https://github.com/airflow-helm/charts/pull/777)) + ## [8.7.1] - 2023-05-13 -> 🟥 __WARNINGS__ 🟥 +> 🟨 __NOTES__ 🟨 > > - this is the first version of the chart with support for airflow 2.6, along with pretty much all previous versions of airflow, see the [airflow version support matrix](https://github.com/airflow-helm/charts/tree/main/charts/airflow#airflow-version-support) @@ -34,12 +59,6 @@ TBD > - when upgrading to airflow 2.5, you may wish to rename your kubernetes `aiflow.config` from `AIRFLOW__KUBERNETES__*` to `AIRFLOW__KUBERNETES_EXECUTOR__*`, as the former was deprecated by airflow 2.5 > - the chart should no longer be forever "out of sync" in apps like ArgoCD, as this issue was resolved by [#718](https://github.com/airflow-helm/charts/pull/718) -> 🟦 __OTHER__ 🟦 -> -> - If you appreciate the `User-Community Airflow Helm Chart` please consider supporting us! -> - [give a ⭐ on GitHub](https://github.com/airflow-helm/charts/stargazers) -> - [give a ⭐ on ArtifactHub](https://artifacthub.io/packages/helm/airflow-helm/airflow) - ### Changed - the default airflow image is now `apache/airflow:2.5.3-python3.8` (see the [airflow version support matrix](https://github.com/airflow-helm/charts/tree/main/charts/airflow#airflow-version-support)) - the default git-sync image is now `registry.k8s.io/git-sync/git-sync:v3.6.5` @@ -765,7 +784,8 @@ TBD > > - To read about versions `7.0.0` and before, please see the [legacy repo](https://github.com/helm/charts/tree/master/stable/airflow). -[Unreleased]: https://github.com/airflow-helm/charts/compare/airflow-8.7.1...HEAD +[Unreleased]: https://github.com/airflow-helm/charts/compare/airflow-8.8.0...HEAD +[8.8.0]: https://github.com/airflow-helm/charts/compare/airflow-8.7.1...airflow-8.8.0 [8.7.1]: https://github.com/airflow-helm/charts/compare/airflow-8.7.0...airflow-8.7.1 [8.7.0]: https://github.com/airflow-helm/charts/compare/airflow-8.6.1...airflow-8.7.0 [8.6.1]: https://github.com/airflow-helm/charts/compare/airflow-8.6.0...airflow-8.6.1 diff --git a/charts/airflow/Chart.yaml b/charts/airflow/Chart.yaml index 9832920d..d15b12d7 100644 --- a/charts/airflow/Chart.yaml +++ b/charts/airflow/Chart.yaml @@ -1,8 +1,8 @@ apiVersion: v2 description: Airflow Helm Chart (User Community) - the standard way to deploy Apache Airflow on Kubernetes with Helm name: airflow -version: 8.7.1 -appVersion: 2.5.3 +version: 8.8.0 +appVersion: 2.6.3 icon: https://avatars.githubusercontent.com/u/71061241 home: https://github.com/airflow-helm/charts/tree/main/charts/airflow maintainers: diff --git a/charts/airflow/README.md b/charts/airflow/README.md index ec0bd552..9b992295 100644 --- a/charts/airflow/README.md +++ b/charts/airflow/README.md @@ -68,7 +68,7 @@ Please note, this chart is __independent__ from the official chart in the `apach ## Key Features - __Support for Airflow Versions:__ - - [`1.10` | `2.0` | `2.1` | `2.2` | `2.3` | `2.4` | `2.5`](#airflow-version-support) + - [`1.10` | `2.0` | `2.1` | `2.2` | `2.3` | `2.4` | `2.5` | `2.6` | `2.7`](#airflow-version-support) - __Support for Airflow Executors:__ - [`CeleryExecutor` | `KubernetesExecutor` | `CeleryKubernetesExecutor`](#airflow-executor-support) - __Easily Connect with your Database:__ @@ -158,16 +158,17 @@ Please note, this chart is __independent__ from the official chart in the `apach The following table lists the __airflow versions__ supported by this chart (set the version with [`airflow.image.tag`](https://github.com/airflow-helm/charts/tree/main/charts/airflow/docs/faq/configuration/airflow-version.md) value). -Chart Version →
Airflow Version ↓ | `7.0.0` - `7.16.0` | `8.0.0` - `8.5.3` | `8.6.0` | `8.6.1 - 8.7.0` | `8.7.1+` ---- | --- | --- | --- | --- | --- -`1.10.X` | ✔️ | ✔️ [1] | ✔️️ [1] | ✔️️ [1] | ✔️️ [1] -`2.0.X` | ❌ | ✔️ | ✔️ | ✔️ | ✔️️ -`2.1.X` | ❌ | ✔️ | ✔️ | ✔️ | ✔️️ -`2.2.X` | ❌ | ⚠️ [2] | ✔️️ | ✔️ | ✔️️ -`2.3.X` | ❌ | ❌ | ❌ | ✔️️ | ✔️️ -`2.4.X` | ❌ | ❌ | ❌ | ✔️️ | ✔️️ -`2.5.X` | ❌ | ❌ | ❌ | ✔️️ | ✔️️ -`2.6.X` | ❌ | ❌ | ❌ | ❌ | ✔️️ +Chart Version →
Airflow Version ↓ | `7.0.0` - `7.16.0` | `8.0.0` - `8.5.3` | `8.6.0` | `8.6.1 - 8.7.0` | `8.7.1` | `8.8.0+` +--- | --- | --- | --- | --- | --- | --- +`1.10.X` | ✔️ | ✔️ [1] | ✔️️ [1] | ✔️️ [1] | ✔️️ [1] | ✔️️ [1] +`2.0.X` | ❌ | ✔️ | ✔️ | ✔️ | ✔️️ | ✔️️ +`2.1.X` | ❌ | ✔️ | ✔️ | ✔️ | ✔️️ | ✔️️ +`2.2.X` | ❌ | ⚠️ [2] | ✔️️ | ✔️ | ✔️️ | ✔️️ +`2.3.X` | ❌ | ❌ | ❌ | ✔️️ | ✔️️ | ✔️️ +`2.4.X` | ❌ | ❌ | ❌ | ✔️️ | ✔️️ | ✔️️ +`2.5.X` | ❌ | ❌ | ❌ | ✔️️ | ✔️️ | ✔️️ +`2.6.X` | ❌ | ❌ | ❌ | ❌ | ✔️️ | ✔️️ +`2.7.X` | ❌ | ❌ | ❌ | ❌ | ❌ | ✔️️ [1] you must set `airflow.legacyCommands = true` when using airflow version `1.10.X`
[2] the [Deferrable Operators & Triggers](https://airflow.apache.org/docs/apache-airflow/stable/concepts/deferring.html) feature won't work, as there is no `airflow triggerer` Deployment diff --git a/charts/airflow/docs/faq/configuration/airflow-plugins.md b/charts/airflow/docs/faq/configuration/airflow-plugins.md index d859b0d4..e12dc91d 100644 --- a/charts/airflow/docs/faq/configuration/airflow-plugins.md +++ b/charts/airflow/docs/faq/configuration/airflow-plugins.md @@ -23,10 +23,10 @@ You may embed your [Airflow Plugins](https://airflow.apache.org/docs/apache-airf This chart uses the official [`apache/airflow`](https://hub.docker.com/r/apache/airflow) Docker images. -Here is a Dockerfile that extends `apache/airflow:2.5.3-python3.8` with custom plugins: +Here is a Dockerfile that extends `apache/airflow:2.6.3-python3.9` with custom plugins: ```dockerfile -FROM apache/airflow:2.5.3-python3.8 +FROM apache/airflow:2.6.3-python3.9 # plugin files can be copied under `/home/airflow/plugins` # (where `./plugins` is relative to the docker build context) diff --git a/charts/airflow/docs/faq/configuration/extra-python-packages.md b/charts/airflow/docs/faq/configuration/extra-python-packages.md index debea781..c9ad7c7b 100644 --- a/charts/airflow/docs/faq/configuration/extra-python-packages.md +++ b/charts/airflow/docs/faq/configuration/extra-python-packages.md @@ -192,10 +192,10 @@ You may embed your python packages directly into the container image. This chart uses the official [`apache/airflow`](https://hub.docker.com/r/apache/airflow) Docker images. -Here is a Dockerfile that extends `apache/airflow:2.5.3-python3.8` with the `torch` package: +Here is a Dockerfile that extends `apache/airflow:2.6.3-python3.9` with the `torch` package: ```dockerfile -FROM apache/airflow:2.5.3-python3.8 +FROM apache/airflow:2.6.3-python3.9 # install your pip packages RUN pip install --no-cache-dir \ diff --git a/charts/airflow/docs/faq/dags/load-dag-definitions.md b/charts/airflow/docs/faq/dags/load-dag-definitions.md index 95005f56..c2054253 100644 --- a/charts/airflow/docs/faq/dags/load-dag-definitions.md +++ b/charts/airflow/docs/faq/dags/load-dag-definitions.md @@ -249,10 +249,10 @@ You may embed your DAG files directly into the container image. This chart uses the official [`apache/airflow`](https://hub.docker.com/r/apache/airflow) Docker images. -Here is a Dockerfile that extends `apache/airflow:2.5.3-python3.8` by placing DAG files into `/opt/airflow/dags`: +Here is a Dockerfile that extends `apache/airflow:2.6.3-python3.9` by placing DAG files into `/opt/airflow/dags`: ```dockerfile -FROM apache/airflow:2.5.3-python3.8 +FROM apache/airflow:2.6.3-python3.9 ## copy the content of local folder `./my_dag_folder` into container folder `/opt/airflow/dags` COPY ./my_dag_folder /opt/airflow/dags diff --git a/charts/airflow/examples/google-gke/custom-values.yaml b/charts/airflow/examples/google-gke/custom-values.yaml index 369e13d6..1d5acf73 100644 --- a/charts/airflow/examples/google-gke/custom-values.yaml +++ b/charts/airflow/examples/google-gke/custom-values.yaml @@ -9,7 +9,7 @@ airflow: ## [FAQ] https://github.com/airflow-helm/charts/blob/main/charts/airflow/docs/faq/configuration/airflow-version.md image: repository: apache/airflow - tag: 2.5.3-python3.8 + tag: 2.6.3-python3.9 ## the airflow executor type to use executor: CeleryExecutor diff --git a/charts/airflow/examples/minikube/custom-values.yaml b/charts/airflow/examples/minikube/custom-values.yaml index 44a7b686..d5085daa 100644 --- a/charts/airflow/examples/minikube/custom-values.yaml +++ b/charts/airflow/examples/minikube/custom-values.yaml @@ -9,7 +9,7 @@ airflow: ## [FAQ] https://github.com/airflow-helm/charts/blob/main/charts/airflow/docs/faq/configuration/airflow-version.md image: repository: apache/airflow - tag: 2.5.3-python3.8 + tag: 2.6.3-python3.9 ## the airflow executor type to use executor: CeleryExecutor diff --git a/charts/airflow/sample-values-CeleryExecutor.yaml b/charts/airflow/sample-values-CeleryExecutor.yaml index ee3c353a..76be4e08 100644 --- a/charts/airflow/sample-values-CeleryExecutor.yaml +++ b/charts/airflow/sample-values-CeleryExecutor.yaml @@ -9,7 +9,7 @@ airflow: ## [FAQ] https://github.com/airflow-helm/charts/blob/main/charts/airflow/docs/faq/configuration/airflow-version.md image: repository: apache/airflow - tag: 2.5.3-python3.8 + tag: 2.6.3-python3.9 ## the airflow executor type to use executor: CeleryExecutor diff --git a/charts/airflow/sample-values-CeleryKubernetesExecutor.yaml b/charts/airflow/sample-values-CeleryKubernetesExecutor.yaml index e2ba1aa1..b3775eac 100644 --- a/charts/airflow/sample-values-CeleryKubernetesExecutor.yaml +++ b/charts/airflow/sample-values-CeleryKubernetesExecutor.yaml @@ -9,7 +9,7 @@ airflow: ## [FAQ] https://github.com/airflow-helm/charts/blob/main/charts/airflow/docs/faq/configuration/airflow-version.md image: repository: apache/airflow - tag: 2.5.3-python3.8 + tag: 2.6.3-python3.9 ## the airflow executor type to use executor: CeleryKubernetesExecutor diff --git a/charts/airflow/sample-values-KubernetesExecutor.yaml b/charts/airflow/sample-values-KubernetesExecutor.yaml index 8ccbdd46..afe5c8c1 100644 --- a/charts/airflow/sample-values-KubernetesExecutor.yaml +++ b/charts/airflow/sample-values-KubernetesExecutor.yaml @@ -9,7 +9,7 @@ airflow: ## [FAQ] https://github.com/airflow-helm/charts/blob/main/charts/airflow/docs/faq/configuration/airflow-version.md image: repository: apache/airflow - tag: 2.5.3-python3.8 + tag: 2.6.3-python3.9 ## the airflow executor type to use executor: KubernetesExecutor diff --git a/charts/airflow/values.yaml b/charts/airflow/values.yaml index 7f4a9e9e..3712eb09 100644 --- a/charts/airflow/values.yaml +++ b/charts/airflow/values.yaml @@ -10,7 +10,7 @@ airflow: ## image: repository: apache/airflow - tag: 2.5.3-python3.8 + tag: 2.6.3-python3.9 pullPolicy: IfNotPresent pullSecret: "" uid: 50000