Prepare docs 1st wave (RC1) April 2024 (#38863)

* Prepare docs 1st wave (RC1) April 2024 * fix hive change log * fix amazon * update hive CHANGELOG.rst * update celery CHANGELOG.rst * update azure, databricks and sftp * update fab
apache · Apr 10, 2024 · 5fa80b6 · 5fa80b6
1 parent 1608231
commit 5fa80b6
Show file tree

Hide file tree

Showing 211 changed files with 1,599 additions and 296 deletions.
diff --git a/airflow/providers/airbyte/CHANGELOG.rst b/airflow/providers/airbyte/CHANGELOG.rst
@@ -26,6 +26,27 @@
 Changelog
 ---------
 
+3.7.0
+.....
+
+Features
+~~~~~~~~
+
+* ``Ensure Airbyte Provider is Compatible with Cloud and Config APIs (#37943)``
+
+Bug Fixes
+~~~~~~~~~
+
+* ``fix: try002 for provider airbyte (#38786)``
+* ``fix(airbyte): add return statement to yield within a while loop in triggers (#38390)``
+
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
+   * ``Bump ruff to 0.3.3 (#38240)``
+   * ``Add comment about versions updated by release manager (#37488)``
+   * ``Prepare docs 1st wave (RC1) March 2024 (#37876)``
+   * ``Applied D401 to airbyte files. (#37370)``
+
 3.6.0
 .....
 

diff --git a/airflow/providers/airbyte/__init__.py b/airflow/providers/airbyte/__init__.py
@@ -27,7 +27,7 @@
 
 __all__ = ["__version__"]
 
-__version__ = "3.6.0"
+__version__ = "3.7.0"
 
 try:
     from airflow import __version__ as airflow_version

diff --git a/airflow/providers/airbyte/provider.yaml b/airflow/providers/airbyte/provider.yaml
@@ -22,9 +22,10 @@ description: |
   `Airbyte <https://airbyte.com/>`__
 
 state: ready
-source-date-epoch: 1705911770
+source-date-epoch: 1712664229
 # note that those versions are maintained by release manager - do not update them manually
 versions:
+  - 3.7.0
   - 3.6.0
   - 3.5.1
   - 3.5.0

diff --git a/airflow/providers/alibaba/CHANGELOG.rst b/airflow/providers/alibaba/CHANGELOG.rst
@@ -26,6 +26,21 @@
 Changelog
 ---------
 
+2.7.3
+.....
+
+Bug Fixes
+~~~~~~~~~
+
+* ``Avoid use of 'assert' outside of the tests (#37718)``
+
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
+   * ``Bump ruff to 0.3.3 (#38240)``
+   * ``fix: try002 for provider alibaba (#38787)``
+   * ``Prepare docs 1st wave (RC1) March 2024 (#37876)``
+   * ``Add comment about versions updated by release manager (#37488)``
+
 2.7.2
 .....
 

diff --git a/airflow/providers/alibaba/__init__.py b/airflow/providers/alibaba/__init__.py
@@ -27,7 +27,7 @@
 
 __all__ = ["__version__"]
 
-__version__ = "2.7.2"
+__version__ = "2.7.3"
 
 try:
     from airflow import __version__ as airflow_version

diff --git a/airflow/providers/alibaba/provider.yaml b/airflow/providers/alibaba/provider.yaml
@@ -22,9 +22,10 @@ description: |
     Alibaba Cloud integration (including `Alibaba Cloud <https://www.alibabacloud.com/>`__).
 
 state: ready
-source-date-epoch: 1705911780
+source-date-epoch: 1712664294
 # note that those versions are maintained by release manager - do not update them manually
 versions:
+  - 2.7.3
   - 2.7.2
   - 2.7.1
   - 2.7.0

diff --git a/airflow/providers/amazon/CHANGELOG.rst b/airflow/providers/amazon/CHANGELOG.rst
@@ -26,6 +26,56 @@
 Changelog
 ---------
 
+8.20.0
+......
+
+Features
+~~~~~~~~
+
+* ``AWS Batch Executor (#37618)``
+* ``Add fallback 'region_name' value to AWS Executors (#38704)``
+* ``Introduce Amazon Bedrock service (#38602)``
+* ``Amazon Bedrock - Model Customization Jobs (#38693)``
+* ``ECS Executor - add support to adopt orphaned tasks. (#37786)``
+* ``Update AWS auth manager CLI command to not disable AVP schema validation (#38301)``
+
+Bug Fixes
+~~~~~~~~~
+
+* ``Reduce 's3hook' memory usage (#37886)``
+* ``Add check in AWS auth manager to check if the Amazon Verified Permissions schema is up to date (#38333)``
+* ``fix: EmrServerlessStartJobOperator not serializing DAGs correctly when partial/expand is used. (#38022)``
+* ``fix(amazon): add return statement to yield within a while loop in triggers (#38396)``
+* ``Fix set deprecated amazon operators arguments in 'MappedOperator' (#38346)``
+* ``'ECSExecutor' API Retry bug fix (#38118)``
+* ``Fix 'region' argument in 'MappedOperator' based on 'AwsBaseOperator' / 'AwsBaseSensor' (#38178)``
+* ``Fix bug for ECS Executor where tasks were being skipped if one task failed. (#37979)``
+* ``Fix init checks for aws redshift to s3 operator (#37861)``
+
+Misc
+~~~~
+
+* ``Make the method 'BaseAuthManager.is_authorized_custom_view' abstract (#37915)``
+* ``Replace "Role" by "Group" in AWS auth manager (#38078)``
+* ``Avoid use of 'assert' outside of the tests (#37718)``
+* ``Use 'AwsLogsHook' when fetching Glue job logs (#38010)``
+* ``Implement 'filter_permitted_dag_ids' in AWS auth manager (#37666)``
+* ``AWS auth manager CLI: persist the policy store description when doing updates (#37946)``
+* ``Change f-string to formatting into the logging messages for Batch Executor (#37929)``
+
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
+   * ``Update yanked versions in providers changelogs (#38262)``
+   * ``Bump ruff to 0.3.3 (#38240)``
+   * ``Resolve G004: Logging statement uses f-string (#37873)``
+   * ``Add back system test for AWS auth manager (#38044)``
+   * ``Revert "Add system test to test the AWS auth manager (#37947)" (#38004)``
+   * ``Add system test to test the AWS auth manager (#37947)``
+   * ``fix: try002 for provider amazon (#38789)``
+   * ``Typo fix (#38783)``
+   * ``fix: COMMAND string should be raw to avoid SyntaxWarning: invalid escape sequence '\s' (#38734)``
+   * ``Revert "fix: COMMAND string should be raw to avoid SyntaxWarning: invalid escape sequence '\s' (#38734)" (#38864)``
+
 8.19.0
 ......
 

diff --git a/airflow/providers/amazon/__init__.py b/airflow/providers/amazon/__init__.py
@@ -27,7 +27,7 @@
 
 __all__ = ["__version__"]
 
-__version__ = "8.19.0"
+__version__ = "8.20.0"
 
 try:
     from airflow import __version__ as airflow_version

diff --git a/airflow/providers/amazon/provider.yaml b/airflow/providers/amazon/provider.yaml
@@ -22,9 +22,10 @@ description: |
   Amazon integration (including `Amazon Web Services (AWS) <https://aws.amazon.com/>`__).
 
 state: ready
-source-date-epoch: 1709554658
+source-date-epoch: 1712664326
 # note that those versions are maintained by release manager - do not update them manually
 versions:
+  - 8.20.0
   - 8.19.0
   - 8.18.0
   - 8.17.0

diff --git a/airflow/providers/apache/beam/CHANGELOG.rst b/airflow/providers/apache/beam/CHANGELOG.rst
@@ -26,6 +26,24 @@
 Changelog
 ---------
 
+5.6.3
+.....
+
+Bug Fixes
+~~~~~~~~~
+
+* ``fix: skip apache beam pipeline options if value is set to false (#38496)``
+* ``Fix side-effect of default options in Beam Operators (#37916)``
+* ``Avoid to use subprocess in asyncio loop (#38292)``
+* ``Avoid change attributes into the constructor in Apache Beam operators (#37934)``
+
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
+   * ``fix: try002 for provider apache beam (#38790)``
+   * ``Bump ruff to 0.3.3 (#38240)``
+   * ``bump mypy version to 1.9.0 (#38239)``
+   * ``Resolve G004: Logging statement uses f-string (#37873)``
+
 5.6.2
 .....
 

diff --git a/airflow/providers/apache/beam/__init__.py b/airflow/providers/apache/beam/__init__.py
@@ -27,7 +27,7 @@
 
 __all__ = ["__version__"]
 
-__version__ = "5.6.2"
+__version__ = "5.6.3"
 
 try:
     from airflow import __version__ as airflow_version

diff --git a/airflow/providers/apache/beam/provider.yaml b/airflow/providers/apache/beam/provider.yaml
@@ -22,9 +22,10 @@ description: |
     `Apache Beam <https://beam.apache.org/>`__.
 
 state: ready
-source-date-epoch: 1709554784
+source-date-epoch: 1712664558
 # note that those versions are maintained by release manager - do not update them manually
 versions:
+  - 5.6.3
   - 5.6.2
   - 5.6.1
   - 5.6.0

diff --git a/airflow/providers/apache/cassandra/CHANGELOG.rst b/airflow/providers/apache/cassandra/CHANGELOG.rst
@@ -26,6 +26,29 @@
 Changelog
 ---------
 
+3.4.2
+.....
+
+Misc
+~~~~
+
+* ``Re-enable cassandra for Python 3.12 after the driver got libev support (#38314)``
+
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
+   * ``fix: try002 for provider apache cassandra (#38791)``
+   * ``Bump ruff to 0.3.3 (#38240)``
+   * ``Exclude Cassandra for Python 3.12 (#38050)``
+   * ``Revert "Add Python 3.12 support (#36755)" (#38023)``
+   * ``Add Python 3.12 support (#36755)``
+   * ``Prepare docs 1st wave (RC1) March 2024 (#37876)``
+   * ``Add comment about versions updated by release manager (#37488)``
+   * ``Prepare docs 1st wave of Providers February 2024 (#37326)``
+   * ``Add docs for RC2 wave of providers for 2nd round of Jan 2024 (#37019)``
+   * ``Prepare docs 2nd wave of Providers January 2024 (#36945)``
+   * ``Prepare docs 1st wave of Providers January 2024 (#36640)``
+   * ``Speed up autocompletion of Breeze by simplifying provider state (#36499)``
+
 3.4.1
 .....
 

diff --git a/airflow/providers/apache/cassandra/__init__.py b/airflow/providers/apache/cassandra/__init__.py
@@ -27,7 +27,7 @@
 
 __all__ = ["__version__"]
 
-__version__ = "3.4.1"
+__version__ = "3.4.2"
 
 try:
     from airflow import __version__ as airflow_version

diff --git a/airflow/providers/apache/cassandra/provider.yaml b/airflow/providers/apache/cassandra/provider.yaml
@@ -22,9 +22,10 @@ description: |
     `Apache Cassandra <https://cassandra.apache.org/>`__.
 
 state: ready
-source-date-epoch: 1703288104
+source-date-epoch: 1712666716
 # note that those versions are maintained by release manager - do not update them manually
 versions:
+  - 3.4.2
   - 3.4.1
   - 3.4.0
   - 3.3.0

diff --git a/airflow/providers/apache/drill/.latest-doc-only-change.txt b/airflow/providers/apache/drill/.latest-doc-only-change.txt
@@ -1 +1 @@
-5a0be392e66f8e5426ba3478621115e92fcf245b
+83316b81584c9e516a8142778fc509f19d95cc3e
diff --git a/airflow/providers/apache/druid/.latest-doc-only-change.txt b/airflow/providers/apache/druid/.latest-doc-only-change.txt
@@ -1 +1 @@
-6937ae76476b3bc869ef912d000bcc94ad642db1
+0a74928894fb57b0160208262ccacad12da23fc7
diff --git a/airflow/providers/apache/flink/.latest-doc-only-change.txt b/airflow/providers/apache/flink/.latest-doc-only-change.txt
@@ -1 +1 @@
-5a0be392e66f8e5426ba3478621115e92fcf245b
+83316b81584c9e516a8142778fc509f19d95cc3e
diff --git a/airflow/providers/apache/hdfs/.latest-doc-only-change.txt b/airflow/providers/apache/hdfs/.latest-doc-only-change.txt
@@ -1 +1 @@
-cead3da4a6f483fa626b81efd27a24dcb5a36ab0
+e706416cd58c2978a30b2df8d0f09993a2b0c36f
diff --git a/airflow/providers/apache/hive/CHANGELOG.rst b/airflow/providers/apache/hive/CHANGELOG.rst
@@ -38,12 +38,25 @@ Changed the default value of ``use_beeline`` in hive cli connection to True.
 Beeline will be always enabled by default in this connection type.
 
 Removed deprecated parameter ``authMechanism`` from HiveHook and dependent operators.
-Use the already existing ``auth_mechanism`` instead in your ``extra``.
+Use ``auth_mechanism`` instead in your ``extra``.
 
-Removed the method ``get_hook`` from hive operator. Use the ``hook`` property instead.
+HiveOperator: Removed the method ``get_hook``  in favor of ``hook`` property instead.
 
-Removed the deprecated ``col_blacklist`` property from HiveStatsCollectionOperator.
-Please rename it to ``excluded_columns`` instead.
+HiveStatsCollectionOperator: Removed the deprecated ``col_blacklist`` in favor of ``excluded_columns``.
+
+* ``Setting use_beeline by default for hive cli connection (#38763)``
+* ``Removing deprecated code in hive provider (#38859)``
+
+Features
+~~~~~~~~
+
+* ``Adding support to hive hook for high availability Hive installations (#38651)``
+
+.. Review and move the new changes to one of the sections above:
+   * ``Fix TRY002 for apache hive provider (#38781)``
+   * ``Bump ruff to 0.3.3 (#38240)``
+   * ``Fix D105 for Apache Hive Provider (#38042)``
+   * ``Fix deprecated apache.hive operators arguments in 'MappedOperator' (#38351)``
 
 7.0.1
 .....

diff --git a/airflow/providers/apache/hive/__init__.py b/airflow/providers/apache/hive/__init__.py
@@ -27,7 +27,7 @@
 
 __all__ = ["__version__"]
 
-__version__ = "7.0.1"
+__version__ = "8.0.0"
 
 try:
     from airflow import __version__ as airflow_version

diff --git a/airflow/providers/apache/impala/.latest-doc-only-change.txt b/airflow/providers/apache/impala/.latest-doc-only-change.txt
@@ -1 +1 @@
-5a0be392e66f8e5426ba3478621115e92fcf245b
+83316b81584c9e516a8142778fc509f19d95cc3e
diff --git a/airflow/providers/apache/kafka/.latest-doc-only-change.txt b/airflow/providers/apache/kafka/.latest-doc-only-change.txt
@@ -1 +1 @@
-5a0be392e66f8e5426ba3478621115e92fcf245b
+3f52790d425cd51386715c240d9a38a20756de2a
diff --git a/airflow/providers/apache/kylin/.latest-doc-only-change.txt b/airflow/providers/apache/kylin/.latest-doc-only-change.txt
@@ -1 +1 @@
-5a0be392e66f8e5426ba3478621115e92fcf245b
+83316b81584c9e516a8142778fc509f19d95cc3e
diff --git a/airflow/providers/apache/livy/.latest-doc-only-change.txt b/airflow/providers/apache/livy/.latest-doc-only-change.txt
@@ -1 +1 @@
-b15d5578dac73c4c6a3ca94d90ab0dc9e9e74c9c
+0a74928894fb57b0160208262ccacad12da23fc7
diff --git a/airflow/providers/apache/pig/.latest-doc-only-change.txt b/airflow/providers/apache/pig/.latest-doc-only-change.txt
@@ -1 +1 @@
-5a0be392e66f8e5426ba3478621115e92fcf245b
+83316b81584c9e516a8142778fc509f19d95cc3e
diff --git a/airflow/providers/apache/spark/CHANGELOG.rst b/airflow/providers/apache/spark/CHANGELOG.rst
@@ -29,6 +29,22 @@
 Changelog
 ---------
 
+4.7.2
+.....
+
+Misc
+~~~~
+
+* ``Rename 'SparkSubmitOperator' fields names to comply with templated fields validation (#38051)``
+* ``Rename 'SparkSqlOperator' fields name to comply with templated fields validation (#38045)``
+
+
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
+   * ``Prepare docs 1st wave (RC1) March 2024 (#37876)``
+   * ``Add comment about versions updated by release manager (#37488)``
+   * ``D401 Support in Providers (simple) (#37258)``
+
 4.7.1
 .....
 

diff --git a/airflow/providers/apache/spark/__init__.py b/airflow/providers/apache/spark/__init__.py
@@ -27,7 +27,7 @@
 
 __all__ = ["__version__"]
 
-__version__ = "4.7.1"
+__version__ = "4.7.2"
 
 try:
     from airflow import __version__ as airflow_version

diff --git a/airflow/providers/apache/spark/provider.yaml b/airflow/providers/apache/spark/provider.yaml
@@ -22,9 +22,10 @@ description: |
     `Apache Spark <https://spark.apache.org/>`__
 
 state: ready
-source-date-epoch: 1705911941
+source-date-epoch: 1712664899
 # note that those versions are maintained by release manager - do not update them manually
 versions:
+  - 4.7.2
   - 4.7.1
   - 4.7.0
   - 4.6.0

diff --git a/airflow/providers/apprise/.latest-doc-only-change.txt b/airflow/providers/apprise/.latest-doc-only-change.txt
@@ -1 +1 @@
-5a0be392e66f8e5426ba3478621115e92fcf245b
+83316b81584c9e516a8142778fc509f19d95cc3e
diff --git a/airflow/providers/arangodb/.latest-doc-only-change.txt b/airflow/providers/arangodb/.latest-doc-only-change.txt
@@ -1 +1 @@
-5a0be392e66f8e5426ba3478621115e92fcf245b
+0a74928894fb57b0160208262ccacad12da23fc7
diff --git a/airflow/providers/asana/.latest-doc-only-change.txt b/airflow/providers/asana/.latest-doc-only-change.txt
@@ -1 +1 @@
-5a0be392e66f8e5426ba3478621115e92fcf245b
+0a74928894fb57b0160208262ccacad12da23fc7
diff --git a/airflow/providers/atlassian/jira/.latest-doc-only-change.txt b/airflow/providers/atlassian/jira/.latest-doc-only-change.txt
@@ -1 +1 @@
-5a0be392e66f8e5426ba3478621115e92fcf245b
+0a74928894fb57b0160208262ccacad12da23fc7