Skip to content

Commit

Permalink
Prepare docs for 09 2023 - 1st wave of Providers (#34201)
Browse files Browse the repository at this point in the history
* Prepare docs for 09 2023 - 1st wave of Providers

* fix amazon change log
  • Loading branch information
eladkal committed Sep 8, 2023
1 parent 5744b42 commit 21990ed
Show file tree
Hide file tree
Showing 294 changed files with 2,028 additions and 302 deletions.
19 changes: 19 additions & 0 deletions airflow/providers/airbyte/CHANGELOG.rst
Expand Up @@ -27,6 +27,25 @@ Changelog
---------


3.3.2
.....

Bug Fixes
~~~~~~~~~

* ``fix(providers/airbyte): respect soft_fail argument when exception is raised (#34156)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Prepare docs for Aug 2023 3rd wave of Providers (#33730)``
* ``D401 Support - Providers: Airbyte to Atlassian (Inclusive) (#33354)``
* ``Prepare docs for Aug 2023 2nd wave of Providers (#33291)``
* ``Prepare docs for July 2023 wave of Providers (RC2) (#32381)``
* ``Remove spurious headers for provider changelogs (#32373)``
* ``Prepare docs for July 2023 wave of Providers (#32298)``
* ``D205 Support - Providers: Airbyte and Alibaba (#32214)``
* ``Improve provider documentation and README structure (#32125)``
3.3.1
.....

Expand Down
6 changes: 4 additions & 2 deletions airflow/providers/airbyte/__init__.py
Expand Up @@ -28,14 +28,16 @@

__all__ = ["__version__"]

__version__ = "3.3.1"
__version__ = "3.3.2"

try:
from airflow import __version__ as airflow_version
except ImportError:
from airflow.version import version as airflow_version

if packaging.version.parse(airflow_version) < packaging.version.parse("2.4.0"):
if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.4.0"
):
raise RuntimeError(
f"The package `apache-airflow-providers-airbyte:{__version__}` requires Apache Airflow 2.4.0+" # NOQA: E501
)
1 change: 1 addition & 0 deletions airflow/providers/airbyte/provider.yaml
Expand Up @@ -23,6 +23,7 @@ description: |
suspended: false
versions:
- 3.3.2
- 3.3.1
- 3.3.0
- 3.2.1
Expand Down
8 changes: 8 additions & 0 deletions airflow/providers/alibaba/CHANGELOG.rst
Expand Up @@ -26,6 +26,14 @@
Changelog
---------

2.5.3
.....

Bug Fixes
~~~~~~~~~

* ``fix(providers/alibaba): respect soft_fail argument when exception is raised (#34157)``

2.5.2
.....

Expand Down
2 changes: 1 addition & 1 deletion airflow/providers/alibaba/__init__.py
Expand Up @@ -28,7 +28,7 @@

__all__ = ["__version__"]

__version__ = "2.5.2"
__version__ = "2.5.3"

try:
from airflow import __version__ as airflow_version
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/alibaba/provider.yaml
Expand Up @@ -23,6 +23,7 @@ description: |
suspended: false
versions:
- 2.5.3
- 2.5.2
- 2.5.1
- 2.5.0
Expand Down
50 changes: 49 additions & 1 deletion airflow/providers/amazon/CHANGELOG.rst
Expand Up @@ -25,7 +25,55 @@

Changelog
---------
* ``A bug intoduced in provider-amazon version 8.0.0 caused all 'EcsRunTaskOperator' tasks to detach from the ECS task after 10 minutes and fail - even if the ECS task was still running. In this version we are fixing it by returning the default 'waiter_max_attempts' value to 'sys.maxsize'``

8.7.0
.....

.. warning:: A bug introduced in version 8.0.0 caused all ``EcsRunTaskOperator`` tasks to detach from the ECS task
and fail after 10 minutes, even if the ECS task was still running.
In this version we are fixing it by returning the default ``waiter_max_attempts`` value to ``sys.maxsize``.

Features
~~~~~~~~

* ``Add Amazon SQS Notifier (#33962)``
* ``Add Amazon SNS Notifier (#33828)``

Bug Fixes
~~~~~~~~~

* ``Increase 'waiter_max_attempts' default value in 'EcsRunTaskOperator' (#33712)``
* ``Fix AWS 'EmrStepSensor' ignoring the specified 'aws_conn_id' in deferred mode (#33952)``
* ``Fix type annotation in AppflowHook (#33881)``
* ``Make Amazon Chime connection lazy loaded and consistent with docs (#34000)``
* ``respect "soft_fail" argument when running BatchSensor in deferrable mode (#33405)``

Misc
~~~~

* ``Refactor: Consolidate import and usage of random (#34108)``
* ``Consolidate importing of os.path.* (#34060)``
* ``Refactor regex in providers (#33898)``
* ``Refactor: Simplify loop in aws/triggers/batch.py (#34052)``
* ``Combine similar if logics in providers (#33987)``
* ``Replace single quotes by double quotes in tests (#33864)``
* ``Remove useless string join from providers (#33968)``
* ``Make 'aws.session_factory' part of Amazon provider configuration documentation (#33960)``
* ``Refactor unneeded jumps in providers (#33833)``
* ``Replace try - except pass by contextlib.suppress in providers (#33980)``
* ``Remove some useless try/except from providers code (#33967)``
* ``Refactor: Replace lambdas with comprehensions in providers (#33771)``
* ``Replace sequence concatenation by unpacking in Airflow providers (#33933)``
* ``Reorganize devel_only extra in airflow's setup.py (#33907)``
* ``Remove explicit str concat from Airflow providers package and tests (#33860)``
* ``Improve modules import in AWS provider by move some of them into a type-checking block (#33780)``
* ``Always use 'Literal' from 'typing_extensions' (#33794)``
* ``Use literal dict instead of calling dict() in providers (#33761)``
* ``remove unnecessary and rewrite it using list in providers (#33763)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Add decorator for suppress optional internal methods in Amazon Provider (#34034)``
8.6.0
.....
Expand Down
2 changes: 1 addition & 1 deletion airflow/providers/amazon/__init__.py
Expand Up @@ -28,7 +28,7 @@

__all__ = ["__version__"]

__version__ = "8.6.0"
__version__ = "8.7.0"

try:
from airflow import __version__ as airflow_version
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/amazon/provider.yaml
Expand Up @@ -23,6 +23,7 @@ description: |
suspended: false
versions:
- 8.7.0
- 8.6.0
- 8.5.1
- 8.5.0
Expand Down
9 changes: 9 additions & 0 deletions airflow/providers/apache/beam/CHANGELOG.rst
Expand Up @@ -26,6 +26,15 @@
Changelog
---------

5.2.3
.....

Misc
~~~~

* ``Replace sequence concatenation by unpacking in Airflow providers (#33933)``
* ``Improve modules import in Airflow providers by some of them into a type-checking block (#33754)``

5.2.2
.....

Expand Down
2 changes: 1 addition & 1 deletion airflow/providers/apache/beam/__init__.py
Expand Up @@ -28,7 +28,7 @@

__all__ = ["__version__"]

__version__ = "5.2.2"
__version__ = "5.2.3"

try:
from airflow import __version__ as airflow_version
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/apache/beam/provider.yaml
Expand Up @@ -23,6 +23,7 @@ description: |
suspended: false
versions:
- 5.2.3
- 5.2.2
- 5.2.1
- 5.2.0
Expand Down
13 changes: 13 additions & 0 deletions airflow/providers/apache/drill/CHANGELOG.rst
Expand Up @@ -27,6 +27,19 @@ Changelog
---------


2.4.4
.....

Misc
~~~~

* ``Improve modules import in Airflow providers by some of them into a type-checking block (#33754)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Prepare docs for Aug 2023 3rd wave of Providers (#33730)``
* ``D401 Support - Providers: Airbyte to Atlassian (Inclusive) (#33354)``
2.4.3
.....

Expand Down
2 changes: 1 addition & 1 deletion airflow/providers/apache/drill/__init__.py
Expand Up @@ -28,7 +28,7 @@

__all__ = ["__version__"]

__version__ = "2.4.3"
__version__ = "2.4.4"

try:
from airflow import __version__ as airflow_version
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/apache/drill/provider.yaml
Expand Up @@ -23,6 +23,7 @@ description: |
suspended: false
versions:
- 2.4.4
- 2.4.3
- 2.4.2
- 2.4.1
Expand Down
8 changes: 8 additions & 0 deletions airflow/providers/apache/flink/CHANGELOG.rst
Expand Up @@ -26,6 +26,14 @@
Changelog
---------

1.1.3
.....

Misc
~~~~

* ``Improve modules import in Airflow providers by some of them into a type-checking block (#33754)``

1.1.2
.....

Expand Down
2 changes: 1 addition & 1 deletion airflow/providers/apache/flink/__init__.py
Expand Up @@ -28,7 +28,7 @@

__all__ = ["__version__"]

__version__ = "1.1.2"
__version__ = "1.1.3"

try:
from airflow import __version__ as airflow_version
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/apache/flink/provider.yaml
Expand Up @@ -23,6 +23,7 @@ description: |
suspended: false
versions:
- 1.1.3
- 1.1.2
- 1.1.1
- 1.1.0
Expand Down
22 changes: 22 additions & 0 deletions airflow/providers/apache/hdfs/CHANGELOG.rst
Expand Up @@ -27,6 +27,28 @@
Changelog
---------

4.1.1
.....

Misc
~~~~

* ``Fix package name in exception message for hdfs provider (#33813)``


.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Use correct headings in HDFS Provider changelog (#33809)``
* ``Prepare docs for Aug 2023 3rd wave of Providers (#33730)``
* ``D401 Support - Providers: Airbyte to Atlassian (Inclusive) (#33354)``
* ``Prepare docs for Aug 2023 2nd wave of Providers (#33291)``
* ``Prepare docs for July 2023 wave of Providers (RC2) (#32381)``
* ``Remove spurious headers for provider changelogs (#32373)``
* ``Prepare docs for July 2023 wave of Providers (#32298)``
* ``D205 Support - Providers: Apache to Common (inclusive) (#32226)``
* ``Improve provider documentation and README structure (#32125)``
* ``Fix typos (double words and it's/its) (#33623)``
4.1.0
.....

Expand Down
6 changes: 4 additions & 2 deletions airflow/providers/apache/hdfs/__init__.py
Expand Up @@ -28,14 +28,16 @@

__all__ = ["__version__"]

__version__ = "4.1.0"
__version__ = "4.1.1"

try:
from airflow import __version__ as airflow_version
except ImportError:
from airflow.version import version as airflow_version

if packaging.version.parse(airflow_version) < packaging.version.parse("2.4.0"):
if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.4.0"
):
raise RuntimeError(
f"The package `apache-airflow-providers-apache-hdfs:{__version__}` requires Apache Airflow 2.4.0+" # NOQA: E501
)
1 change: 1 addition & 0 deletions airflow/providers/apache/hdfs/provider.yaml
Expand Up @@ -24,6 +24,7 @@ description: |
suspended: false
versions:
- 4.1.1
- 4.1.0
- 4.0.0
- 3.2.1
Expand Down
15 changes: 15 additions & 0 deletions airflow/providers/apache/hive/CHANGELOG.rst
Expand Up @@ -27,6 +27,21 @@
Changelog
---------

6.1.6
.....

Misc
~~~~

* ``Refactor regex in providers (#33898)``
* ``Replace sequence concatenation by unpacking in Airflow providers (#33933)``
* ``Replace single element slice by next() in hive provider (#33937)``
* ``Use a single statement with multiple contexts instead of nested statements in providers (#33768)``
* ``Use startswith once with a tuple in Hive hook (#33765)``
* ``Refactor: Simplify a few loops (#33736)``
* ``E731: replace lambda by a def method in Airflow providers (#33757)``
* ``Use f-string instead of in Airflow providers (#33752)``

6.1.5
.....

Expand Down
2 changes: 1 addition & 1 deletion airflow/providers/apache/hive/__init__.py
Expand Up @@ -28,7 +28,7 @@

__all__ = ["__version__"]

__version__ = "6.1.5"
__version__ = "6.1.6"

try:
from airflow import __version__ as airflow_version
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/apache/hive/provider.yaml
Expand Up @@ -23,6 +23,7 @@ description: |
suspended: false
versions:
- 6.1.6
- 6.1.5
- 6.1.4
- 6.1.3
Expand Down
8 changes: 8 additions & 0 deletions airflow/providers/apache/impala/CHANGELOG.rst
Expand Up @@ -26,6 +26,14 @@
Changelog
---------

1.1.3
.....

Misc
~~~~

* ``Improve modules import in Airflow providers by some of them into a type-checking block (#33754)``

1.1.2
.....

Expand Down
6 changes: 4 additions & 2 deletions airflow/providers/apache/impala/__init__.py
Expand Up @@ -28,14 +28,16 @@

__all__ = ["__version__"]

__version__ = "1.1.2"
__version__ = "1.1.3"

try:
from airflow import __version__ as airflow_version
except ImportError:
from airflow.version import version as airflow_version

if packaging.version.parse(airflow_version) < packaging.version.parse("2.4.0"):
if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.4.0"
):
raise RuntimeError(
f"The package `apache-airflow-providers-apache-impala:{__version__}` requires Apache Airflow 2.4.0+" # NOQA: E501
)
1 change: 1 addition & 0 deletions airflow/providers/apache/impala/provider.yaml
Expand Up @@ -23,6 +23,7 @@ description: |
suspended: false
versions:
- 1.1.3
- 1.1.2
- 1.1.1
- 1.1.0
Expand Down

0 comments on commit 21990ed

Please sign in to comment.