Suspend qubole provider (#33889)

* Suspend qubole provider

Qubole has been acquired and seems that maintainers have left the project
https://github.com/qubole/qds-sdk-py#where-are-the-maintainers-
the package has been unmaintained for a long time and it's likely no-one uses it
until someone steps up to maintain it, we suspend it


Co-authored-by: Jed Cunningham <66968678+jedcunningham@users.noreply.github.com>

CONTRIBUTING.rst

@@ -677,9 +677,9 @@ druid, elasticsearch, exasol, facebook, ftp, gcp, gcp_api, github, github_enterp
 google_auth, grpc, hashicorp, hdfs, hive, http, imap, influxdb, jdbc, jenkins, kerberos, kubernetes,
 ldap, leveldb, microsoft.azure, microsoft.mssql, microsoft.psrp, microsoft.winrm, mongo, mssql,
 mysql, neo4j, odbc, openfaas, openlineage, opsgenie, oracle, otel, pagerduty, pandas, papermill,
-password, pinot, plexus, postgres, presto, qds, qubole, rabbitmq, redis, s3, salesforce, samba,
-segment, sendgrid, sentry, sftp, singularity, slack, smtp, snowflake, spark, sqlite, ssh, statsd,
-tableau, tabular, telegram, trino, vertica, virtualenv, webhdfs, winrm, yandex, zendesk
+password, pinot, plexus, postgres, presto, rabbitmq, redis, s3, salesforce, samba, segment,
+sendgrid, sentry, sftp, singularity, slack, smtp, snowflake, spark, sqlite, ssh, statsd, tableau,
+tabular, telegram, trino, vertica, virtualenv, webhdfs, winrm, yandex, zendesk
   .. END EXTRAS HERE
 
 Provider packages

INSTALL

@@ -104,9 +104,9 @@ druid, elasticsearch, exasol, facebook, ftp, gcp, gcp_api, github, github_enterp
 google_auth, grpc, hashicorp, hdfs, hive, http, imap, influxdb, jdbc, jenkins, kerberos, kubernetes,
 ldap, leveldb, microsoft.azure, microsoft.mssql, microsoft.psrp, microsoft.winrm, mongo, mssql,
 mysql, neo4j, odbc, openfaas, openlineage, opsgenie, oracle, otel, pagerduty, pandas, papermill,
-password, pinot, plexus, postgres, presto, qds, qubole, rabbitmq, redis, s3, salesforce, samba,
-segment, sendgrid, sentry, sftp, singularity, slack, smtp, snowflake, spark, sqlite, ssh, statsd,
-tableau, tabular, telegram, trino, vertica, virtualenv, webhdfs, winrm, yandex, zendesk
+password, pinot, plexus, postgres, presto, rabbitmq, redis, s3, salesforce, samba, segment,
+sendgrid, sentry, sftp, singularity, slack, smtp, snowflake, spark, sqlite, ssh, statsd, tableau,
+tabular, telegram, trino, vertica, virtualenv, webhdfs, winrm, yandex, zendesk
 # END EXTRAS HERE
 
 # For installing Airflow in development environments - see CONTRIBUTING.rst

airflow/providers/SUSPENDING_AND_RESUMING_PROVIDERS.rst

@@ -20,7 +20,7 @@ Suspending providers
 
 As of April 2023, we have the possibility to suspend individual providers, so that they are not holding
 back dependencies for Airflow and other providers. The process of suspending providers is described
-in `description of the process <https://github.com/apache/airflow/blob/main/README.md#suspending-releases-for-providers>`_
+in `description of the process <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#suspending-releases-for-providers>`_
 
 Technically, suspending a provider is done by setting ``suspended : true``, in the provider.yaml of the
 provider. This should be followed by committing the change and either automatically or manually running

airflow/providers/qubole/provider.yaml

@@ -21,7 +21,11 @@ name: Qubole
 description: |
     `Qubole <https://www.qubole.com/>`__
 
-suspended: false
+# Qubole has been acquired and seems that maintainers have left the project
+# https://github.com/qubole/qds-sdk-py#where-are-the-maintainers-
+# the package has been unmaintained for a long time and it's likely no-one uses it
+# until someone steps up to maintain it, we suspend it
+suspended: true
 versions:
   - 3.4.2
   - 3.4.1

dev/breeze/tests/test_selective_checks.py

@@ -1016,7 +1016,6 @@ def test_upgrade_to_newer_dependencies(
                 "--package-filter apache-airflow-providers-oracle "
                 "--package-filter apache-airflow-providers-postgres "
                 "--package-filter apache-airflow-providers-presto "
-                "--package-filter apache-airflow-providers-qubole "
                 "--package-filter apache-airflow-providers-slack "
                 "--package-filter apache-airflow-providers-snowflake "
                 "--package-filter apache-airflow-providers-sqlite "

docs/apache-airflow/extra-packages-ref.rst

@@ -194,8 +194,6 @@ These are extras that add dependencies needed for integration with external serv
 +---------------------+-----------------------------------------------------+-----------------------------------------------------+
 | plexus              | ``pip install 'apache-airflow[plexus]'``            | Plexus service of CoreScientific.com AI platform    |
 +---------------------+-----------------------------------------------------+-----------------------------------------------------+
-| qubole              | ``pip install 'apache-airflow[qubole]'``            | Enable QDS (Qubole Data Service) support            |
-+---------------------+-----------------------------------------------------+-----------------------------------------------------+
 | salesforce          | ``pip install 'apache-airflow[salesforce]'``        | Salesforce hook                                     |
 +---------------------+-----------------------------------------------------+-----------------------------------------------------+
 | sendgrid            | ``pip install 'apache-airflow[sendgrid]'``          | Send email using sendgrid                           |

generated/provider_dependencies.json

@@ -740,17 +740,6 @@
     ],
     "excluded-python-versions": []
   },
-  "qubole": {
-    "deps": [
-      "apache-airflow-providers-common-sql>=1.3.1",
-      "apache-airflow>=2.4.0",
-      "qds-sdk>=1.10.4"
-    ],
-    "cross-providers-deps": [
-      "common.sql"
-    ],
-    "excluded-python-versions": []
-  },
   "redis": {
     "deps": [
       "apache-airflow>=2.4.0",

images/breeze/output-commands-hash.txt

@@ -2,7 +2,7 @@
 # Please do not solve it but run `breeze setup regenerate-command-images`.
 # This command should fix the conflict and regenerate help images that you have conflict with.
 main:42493af4045e28dcf52040810fbb7036
-build-docs:173a48b2e23c17fa5adf394fc5c8a71e
+build-docs:0a96708d971499a41b73ba7f357154ef
 ci:find-backtracking-candidates:17fe56b867a745e5032a08dfcd3f73ee
 ci:fix-ownership:3e5a73533cc96045e72cb258783cfc96
 ci:free-space:49af17b032039c05c41a7a8283f365cc
@@ -36,25 +36,25 @@ prod-image:build:a1a9be1bb6c98b4a178e2e6264984429
 prod-image:pull:3817ef211b023b76df84ee1110ef64dd
 prod-image:verify:bd2b78738a7c388dbad6076c41a9f906
 prod-image:a34b8ffbf7259d8338d044b6cab86c82
-release-management:add-back-references:7e3a4e6d3f7932773cfb256059f7c2c8
+release-management:add-back-references:6da27012538a7cc79ddd4ec650470470
 release-management:create-minor-branch:a3834afc4aa5d1e98002c9e9e7a9931d
 release-management:generate-constraints:4641e174e2ba4184024f466f82f0f8f6
-release-management:generate-issue-content-providers:b810c1afe316edf547572b232759c004
+release-management:generate-issue-content-providers:756d5dfd135c3e473756022ca6150c24
 release-management:generate-providers-metadata:d4e8e5cfaa024e3963af02d7a873048d
 release-management:install-provider-packages:34c38aca17d23dbb454fe7a6bfd8e630
 release-management:prepare-airflow-package:85d01c57e5b5ee0fb9e5f9d9706ed3b5
-release-management:prepare-provider-documentation:01393745645e0307dcc15baaf24d3435
-release-management:prepare-provider-packages:93769f8db9fda9bb28fd0cd1a201cae8
-release-management:publish-docs:60d19a62a115f1fda347c6fba1242b2a
+release-management:prepare-provider-documentation:a53cd338bd719c77108b53bc8d45b634
+release-management:prepare-provider-packages:fc69d2ab8abdcbafcaaa63da380f4b76
+release-management:publish-docs:1c7e6b9af76d663d3af5bec29a21a2ee
 release-management:release-prod-images:cfbfe8b19fee91fd90718f98ef2fd078
 release-management:start-rc-process:b27bd524dd3c89f50a747b60a7e892c1
 release-management:start-release:419f48f6a4ff4457cb9de7ff496aebbe
 release-management:update-constraints:02ec4b119150e3fdbac52026e94820ef
 release-management:verify-provider-packages:96dce5644aad6b37080acf77b3d8de3a
-release-management:232d2f70017ba75e7bc50160678f1c05
-sbom:generate-provider-requirements:42cb9f199c7be30b5bf7102ea175d736
+release-management:89ff9e52d70ee5be8addc6d68cc18702
+sbom:generate-provider-requirements:2ea27f55be4e6ab2b0b5a410330f2747
 sbom:update-sbom-information:fd56648af8e1c8ab59b1b1377c032fb6
-sbom:1f5b421744bc14f2644785907cdfd93a
+sbom:7278ea41cd78e42425eb4933fc84ec6f
 setup:autocomplete:fffcd49e102e09ccd69b3841a9e3ea8e
 setup:check-all-params-in-groups:639dfb061b8da02dcaa4a57b567ff42a
 setup:config:fd32471ee31894decf91984615771add