Skip to content

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot install latest google provider along with kubernetes provider #40230

Closed
2 tasks done
aru-trackunit opened this issue Jun 14, 2024 · 0 comments
Closed
2 tasks done
Labels
area:providers kind:bug This is a clearly a bug needs-triage label for new issues that we didn't triage yet

Comments

@aru-trackunit
Copy link
Contributor

aru-trackunit commented Jun 14, 2024

Apache Airflow Provider(s)

cncf-kubernetes, google

Versions of Apache Airflow Providers

apache-airflow-providers-amazon==8.24.0
apache-airflow-providers-cncf-kubernetes==8.3.1
apache-airflow-providers-common-io==1.3.0
apache-airflow-providers-common-sql==1.11.1
apache-airflow-providers-databricks==6.5.0
apache-airflow-providers-ftp==3.7.0
apache-airflow-providers-github==2.6.1
apache-airflow-providers-google==10.19.0
apache-airflow-providers-hashicorp==3.7.1
apache-airflow-providers-http==4.10.0
apache-airflow-providers-imap==3.5.0
apache-airflow-providers-mysql==5.6.1
apache-airflow-providers-postgres==5.11.1
apache-airflow-providers-sftp==4.10.1
apache-airflow-providers-slack==8.7.1
apache-airflow-providers-smtp==1.6.1
apache-airflow-providers-snowflake==5.5.1
apache-airflow-providers-sqlite==3.7.1
apache-airflow-providers-ssh==3.11.1

Apache Airflow version

2.8.4

Operating System

Debian GNU/Linux 11 (bullseye)

Deployment

Official Apache Airflow Helm Chart

Deployment details

No response

What happened

I am unable to install apache-airflow-providers-google==10.19.0 along with apache-airflow-providers-cncf-kubernetes==8.3.1

What you think should happen instead

Packages should be both compatible

How to reproduce

I couldn't build an image that contains apache-airflow-providers-cncf-kubernetes==8.3.1 and apache-airflow-providers-google==10.19.0 due to package conflicts.
I decided to downgrade cncf to version 7.13.0 that I had previously run the container and try to install newer kubernetes provider to see the exact problem:

pip install apache-airflow-providers-cncf-kubernetes==8.3.1
Output message:

Installing collected packages: cryptography, kubernetes_asyncio, kubernetes, apache-airflow-providers-cncf-kubernetes
  Attempting uninstall: cryptography
    Found existing installation: cryptography 38.0.4
    Uninstalling cryptography-38.0.4:
      Successfully uninstalled cryptography-38.0.4
  Attempting uninstall: kubernetes_asyncio
    Found existing installation: kubernetes-asyncio 24.2.3
    Uninstalling kubernetes-asyncio-24.2.3:
      Successfully uninstalled kubernetes-asyncio-24.2.3
  Attempting uninstall: kubernetes
    Found existing installation: kubernetes 23.6.0
    Uninstalling kubernetes-23.6.0:
      Successfully uninstalled kubernetes-23.6.0
  Attempting uninstall: apache-airflow-providers-cncf-kubernetes
    Found existing installation: apache-airflow-providers-cncf-kubernetes 7.13.0
    Uninstalling apache-airflow-providers-cncf-kubernetes-7.13.0:
      Successfully uninstalled apache-airflow-providers-cncf-kubernetes-7.13.0
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
gcloud-aio-auth 4.1.5 requires cryptography<39.0.0,>=2.0.0, but you have cryptography 42.0.8 which is incompatible.
pyopenssl 23.2.0 requires cryptography!=40.0.0,!=40.0.1,<42,>=38.0.0, but you have cryptography 42.0.8 which is incompatible.
Successfully installed apache-airflow-providers-cncf-kubernetes-8.3.1 cryptography-42.0.8 kubernetes-29.0.0 kubernetes_asyncio-29.0.0

Then I decided to install lower version of cryptography:
pip install cryptography==38.0.4

Output message:

Installing collected packages: cryptography
  Attempting uninstall: cryptography
    Found existing installation: cryptography 42.0.8
    Uninstalling cryptography-42.0.8:
      Successfully uninstalled cryptography-42.0.8
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
apache-airflow-providers-cncf-kubernetes 8.3.1 requires cryptography>=41.0.0, but you have cryptography 38.0.4 which is incompatible.
Successfully installed cryptography-38.0.4

Anything else

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@aru-trackunit aru-trackunit added area:providers kind:bug This is a clearly a bug needs-triage label for new issues that we didn't triage yet labels Jun 14, 2024
@apache apache locked and limited conversation to collaborators Jun 14, 2024
@potiuk potiuk converted this issue into discussion #40236 Jun 14, 2024

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

Labels
area:providers kind:bug This is a clearly a bug needs-triage label for new issues that we didn't triage yet
Projects
None yet
Development

No branches or pull requests

1 participant