Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Do not use constraints when preparing venv for k8s tests on CI #17290

Merged
merged 1 commit into from
Jul 28, 2021

Conversation

potiuk
Copy link
Member

@potiuk potiuk commented Jul 28, 2021

When k8s virtualenv is prepared to run k8s tests we are using
constraints, this however might lead to a problem when we increase
minimum version of an affected dependency and it conflicts with
the constraints stored in main.

Therefore in case we run tests in CI (which is indicated by
specific pull tag that we use) we do not use constraints for
installing the kubernetes venv. It should be fine, as we are
pretty much running this only as a vehicle to run tests.


^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.

When k8s virtualenv is prepared to run k8s tests we are using
constraints, this however might lead to a problem when we increase
minimum version of an affected dependency and it conflicts with
the constraints stored in main.

Therefore in case we run tests in CI (which is indicated by
specific pull tag that we use) we do not use constraints for
installing the kubernetes venv. It should be fine, as we are
pretty much running this only as a vehicle to run tests.
@potiuk potiuk requested a review from ashb as a code owner July 28, 2021 16:49
potiuk added a commit to potiuk/airflow that referenced this pull request Jul 28, 2021
There are some clarifications about using the authentication
via FlaskAppBuilder - the change implements minimum version of the
FAB to 3.3.2 and clarifies the dependencies used in FAB 3 series
to be only authlib rather than flask-oauth.

Fixes: apache#16944 (this is the second, proper fix this time).

Depends on: apache#17290, apache#17289 - those two errors have been detected while
analysing failures in this build.
@potiuk
Copy link
Member Author

potiuk commented Jul 28, 2021

Testing also in #17208 (ti was detected there)

@github-actions github-actions bot added the full tests needed We need to run full set of tests for this PR to merge label Jul 28, 2021
@github-actions
Copy link

The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and take the risk. If they don't merge it quickly - please rebase it to the latest main at your convenience, or amend the last commit of the PR, and push it with --force-with-lease.

@potiuk potiuk merged commit 96bd4a1 into apache:main Jul 28, 2021
@potiuk potiuk deleted the fix-kubernetes-virtualenv-preparation branch July 28, 2021 19:36
potiuk added a commit to potiuk/airflow that referenced this pull request Aug 2, 2021
…e#17290)

When k8s virtualenv is prepared to run k8s tests we are using
constraints, this however might lead to a problem when we increase
minimum version of an affected dependency and it conflicts with
the constraints stored in main.

Therefore in case we run tests in CI (which is indicated by
specific pull tag that we use) we do not use constraints for
installing the kubernetes venv. It should be fine, as we are
pretty much running this only as a vehicle to run tests.

(cherry picked from commit 96bd4a1)
kaxil pushed a commit that referenced this pull request Aug 17, 2021
When k8s virtualenv is prepared to run k8s tests we are using
constraints, this however might lead to a problem when we increase
minimum version of an affected dependency and it conflicts with
the constraints stored in main.

Therefore in case we run tests in CI (which is indicated by
specific pull tag that we use) we do not use constraints for
installing the kubernetes venv. It should be fine, as we are
pretty much running this only as a vehicle to run tests.

(cherry picked from commit 96bd4a1)
jhtimmins pushed a commit that referenced this pull request Aug 17, 2021
When k8s virtualenv is prepared to run k8s tests we are using
constraints, this however might lead to a problem when we increase
minimum version of an affected dependency and it conflicts with
the constraints stored in main.

Therefore in case we run tests in CI (which is indicated by
specific pull tag that we use) we do not use constraints for
installing the kubernetes venv. It should be fine, as we are
pretty much running this only as a vehicle to run tests.

(cherry picked from commit 96bd4a1)
kaxil added a commit to astronomer/airflow that referenced this pull request Dec 3, 2021
This was failing with following:

```
/Users/kaxilnaik/Documents/GitHub/astronomer/airflow/scripts/ci/kubernetes/ci_run_kubernetes_tests.sh: line 102: constraints[@]: unbound variable
Exporting logs for cluster "airflow-python-3.7-v1.20.2" to:
/tmp/kind_logs_2021-12-03_0_0
```

and was caused by apache#17290
kaxil added a commit that referenced this pull request Dec 3, 2021
This was failing with the following:

```
/Users/kaxilnaik/Documents/GitHub/astronomer/airflow/scripts/ci/kubernetes/ci_run_kubernetes_tests.sh: line 102: constraints[@]: unbound variable
Exporting logs for cluster "airflow-python-3.7-v1.20.2" to:
/tmp/kind_logs_2021-12-03_0_0
```

and was caused by #17290
potiuk pushed a commit that referenced this pull request Jan 22, 2022
This was failing with the following:

```
/Users/kaxilnaik/Documents/GitHub/astronomer/airflow/scripts/ci/kubernetes/ci_run_kubernetes_tests.sh: line 102: constraints[@]: unbound variable
Exporting logs for cluster "airflow-python-3.7-v1.20.2" to:
/tmp/kind_logs_2021-12-03_0_0
```

and was caused by #17290

(cherry picked from commit 0afed43)
jedcunningham pushed a commit that referenced this pull request Jan 27, 2022
This was failing with the following:

```
/Users/kaxilnaik/Documents/GitHub/astronomer/airflow/scripts/ci/kubernetes/ci_run_kubernetes_tests.sh: line 102: constraints[@]: unbound variable
Exporting logs for cluster "airflow-python-3.7-v1.20.2" to:
/tmp/kind_logs_2021-12-03_0_0
```

and was caused by #17290

(cherry picked from commit 0afed43)
leahecole pushed a commit to GoogleCloudPlatform/composer-airflow that referenced this pull request Jun 4, 2022
This was failing with the following:

```
/Users/kaxilnaik/Documents/GitHub/astronomer/airflow/scripts/ci/kubernetes/ci_run_kubernetes_tests.sh: line 102: constraints[@]: unbound variable
Exporting logs for cluster "airflow-python-3.7-v1.20.2" to:
/tmp/kind_logs_2021-12-03_0_0
```

and was caused by apache/airflow#17290

(cherry picked from commit 0afed43a8afde093277be2862138cb32fba8ed29)

GitOrigin-RevId: 85cce0769460829865c5f374809607ad922de715
kosteev pushed a commit to GoogleCloudPlatform/composer-airflow that referenced this pull request Jul 10, 2022
This was failing with the following:

```
/Users/kaxilnaik/Documents/GitHub/astronomer/airflow/scripts/ci/kubernetes/ci_run_kubernetes_tests.sh: line 102: constraints[@]: unbound variable
Exporting logs for cluster "airflow-python-3.7-v1.20.2" to:
/tmp/kind_logs_2021-12-03_0_0
```

and was caused by apache/airflow#17290

GitOrigin-RevId: 0afed43a8afde093277be2862138cb32fba8ed29
leahecole pushed a commit to GoogleCloudPlatform/composer-airflow that referenced this pull request Aug 27, 2022
This was failing with the following:

```
/Users/kaxilnaik/Documents/GitHub/astronomer/airflow/scripts/ci/kubernetes/ci_run_kubernetes_tests.sh: line 102: constraints[@]: unbound variable
Exporting logs for cluster "airflow-python-3.7-v1.20.2" to:
/tmp/kind_logs_2021-12-03_0_0
```

and was caused by apache/airflow#17290

GitOrigin-RevId: 0afed43a8afde093277be2862138cb32fba8ed29
leahecole pushed a commit to GoogleCloudPlatform/composer-airflow that referenced this pull request Oct 4, 2022
This was failing with the following:

```
/Users/kaxilnaik/Documents/GitHub/astronomer/airflow/scripts/ci/kubernetes/ci_run_kubernetes_tests.sh: line 102: constraints[@]: unbound variable
Exporting logs for cluster "airflow-python-3.7-v1.20.2" to:
/tmp/kind_logs_2021-12-03_0_0
```

and was caused by apache/airflow#17290

GitOrigin-RevId: 0afed43a8afde093277be2862138cb32fba8ed29
aglipska pushed a commit to GoogleCloudPlatform/composer-airflow that referenced this pull request Oct 7, 2022
This was failing with the following:

```
/Users/kaxilnaik/Documents/GitHub/astronomer/airflow/scripts/ci/kubernetes/ci_run_kubernetes_tests.sh: line 102: constraints[@]: unbound variable
Exporting logs for cluster "airflow-python-3.7-v1.20.2" to:
/tmp/kind_logs_2021-12-03_0_0
```

and was caused by apache/airflow#17290

GitOrigin-RevId: 0afed43a8afde093277be2862138cb32fba8ed29
leahecole pushed a commit to GoogleCloudPlatform/composer-airflow that referenced this pull request Dec 7, 2022
This was failing with the following:

```
/Users/kaxilnaik/Documents/GitHub/astronomer/airflow/scripts/ci/kubernetes/ci_run_kubernetes_tests.sh: line 102: constraints[@]: unbound variable
Exporting logs for cluster "airflow-python-3.7-v1.20.2" to:
/tmp/kind_logs_2021-12-03_0_0
```

and was caused by apache/airflow#17290

GitOrigin-RevId: 0afed43a8afde093277be2862138cb32fba8ed29
leahecole pushed a commit to GoogleCloudPlatform/composer-airflow that referenced this pull request Jan 27, 2023
This was failing with the following:

```
/Users/kaxilnaik/Documents/GitHub/astronomer/airflow/scripts/ci/kubernetes/ci_run_kubernetes_tests.sh: line 102: constraints[@]: unbound variable
Exporting logs for cluster "airflow-python-3.7-v1.20.2" to:
/tmp/kind_logs_2021-12-03_0_0
```

and was caused by apache/airflow#17290

GitOrigin-RevId: 0afed43a8afde093277be2862138cb32fba8ed29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:dev-tools full tests needed We need to run full set of tests for this PR to merge
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants