Skip to content

Temporarily exclude openlineage from "PyPI" constraints generation#33101

Merged
potiuk merged 1 commit intoapache:mainfrom
potiuk:suppress-openlineage-in-pypi-constraint-generation
Aug 4, 2023
Merged

Temporarily exclude openlineage from "PyPI" constraints generation#33101
potiuk merged 1 commit intoapache:mainfrom
potiuk:suppress-openlineage-in-pypi-constraint-generation

Conversation

@potiuk
Copy link
Member

@potiuk potiuk commented Aug 4, 2023

The openlineage provider has apache-airflow >= 2.7.0 as dependency, and this is a problem for automated constraint generation. Since there is only one version of the provider released, it's the only one that can be installed from PyPI, but until apache-airflow 2.7.0 is released it cannot be installed because of the dependency missing.

This makes calculating of the constraints by PyPI impossible and it loops in continuously trying to find a solution that cannot be found.

In order to unblock constraint generation we need to exclude the provider temporarily and regenerate the constraints again when airflow 2.7.0 gets released (which will generally only bring the open-lineage provider as part of the constraints).

(cherry picked from commit b08188e24bf7e52a0b700e083caa38347a4fa3fc)


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

The openlineage provider has apache-airflow >= 2.7.0 as dependency,
and this is a problem for automated constraint generation. Since there
is only one version of the provider released, it's the only one that
can be installed from PyPI, but until apache-airflow 2.7.0 is released
it cannot be installed because of the dependency missing.

This makes calculating of the constraints by PyPI impossible and it
loops in continuously trying to find a solution that cannot be found.

In order to unblock constraint generation we need to exclude the
provider temporarily and regenerate the constraints again when airflow
2.7.0 gets released (which will generally only bring the open-lineage
provider as part of the constraints).

(cherry picked from commit b08188e24bf7e52a0b700e083caa38347a4fa3fc)
@potiuk potiuk requested a review from ashb as a code owner August 4, 2023 07:35
@potiuk potiuk added this to the Airflow 2.7.0 milestone Aug 4, 2023
@potiuk potiuk merged commit f14430d into apache:main Aug 4, 2023
@potiuk potiuk deleted the suppress-openlineage-in-pypi-constraint-generation branch August 4, 2023 07:41
@ephraimbuddy ephraimbuddy added the changelog:skip Changes that should be skipped from the changelog (CI, tests, etc..) label Aug 4, 2023
ephraimbuddy pushed a commit that referenced this pull request Aug 4, 2023
…33101)

The openlineage provider has apache-airflow >= 2.7.0 as dependency,
and this is a problem for automated constraint generation. Since there
is only one version of the provider released, it's the only one that
can be installed from PyPI, but until apache-airflow 2.7.0 is released
it cannot be installed because of the dependency missing.

This makes calculating of the constraints by PyPI impossible and it
loops in continuously trying to find a solution that cannot be found.

In order to unblock constraint generation we need to exclude the
provider temporarily and regenerate the constraints again when airflow
2.7.0 gets released (which will generally only bring the open-lineage
provider as part of the constraints).

(cherry picked from commit b08188e24bf7e52a0b700e083caa38347a4fa3fc)
(cherry picked from commit f14430d)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:dev-tools changelog:skip Changes that should be skipped from the changelog (CI, tests, etc..)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants