Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sync v2-9-stable with v2-9-test to release python client v2.9.0 #39061

Merged
merged 16 commits into from
Apr 22, 2024

Conversation

ephraimbuddy
Copy link
Contributor

Time for python client 2.9.0rc1!

@boring-cyborg boring-cyborg bot added area:API Airflow's REST/HTTP API area:dev-tools area:production-image Production image improvements and fixes kind:documentation labels Apr 16, 2024
Copy link
Member

@potiuk potiuk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It will need one or two cherry-picks more from main to fix but LGTM in general.

Taragolis and others added 8 commits April 16, 2024 16:07
When PROD image packages are installed in in CI, the local sources
should not be present in the image, also constraints from sources
shoudl replace the one downloaded from main.

(cherry picked from commit 246f697)
Follow up after #39035 where local airflow sources have been
removed from PROD image built in CI. The k8s image for tests also
added the sources when preparing the modified image. This is now
avoided - the --no-copy-local-sources is used in CI to avoid it.

(cherry picked from commit 1e9d3d1)
When the whole workflow can be skipped and it's one of the workflows
than nothing depends on, we can skip the whole workflow rather than
individual jobs - then the workflow will not be shown as unfolded
with all the jobs skipped but as a single skipped workflow.

This is what we do for Additional CI image tests and Finalize tests
& special tests.

(cherry picked from commit 3f4872b)
…rs (#38825)

Occasionally `docker syetem prune` fails on Public docker runners with

file resize error: truncate /var/lib/docker/buildkit/containerdmeta.db:
read-only file system

This happens after docker has been already cleaned and should have no
side efects if the metadata db could not be truncated.

Ignoring error in this case should allow the job to continue.

(cherry picked from commit f50cc61)
ephraimbuddy and others added 4 commits April 17, 2024 02:05
The xmlsec used by Amazon provider for authentication has compatiblity
issue with libxmlsec 1.2.* that is used by default in debian bookworm.

We should investigate if/howe we can upgrade our images to support it,
in the meantime we limitt python bindings to < 1.3.13.

See #39103

(cherry picked from commit cd88887)
There is a simple workaround implemented several years ago for Google
provider `project_id` default value being PROVIDE_PROJECT_ID that
satisfy mypy checks for project_id being set. They way how
`fallback_to_default_project_id` works is that across all the
providers the project_id is actually set, even if technically
it's default value is set to None.

This is similar typing workaround as we use for NEW_SESSION in the
core of Airflow.

The workaround has not been applied consistently across all the
google provider code and occasionally it causes MyPy complaining
when newer version of a google library introduces more strict
type checking and expects the provider_id to be set.

This PR applies the workaround across all the Google provider
code.

This is - generally speaking a no-op operation. Nothing changes,
except MyPy being aware that the project_id is actually going to
be set even if it is technically set to None.

(cherry picked from commit 90acbfb)
@jedcunningham jedcunningham merged commit e61cb8f into v2-9-stable Apr 22, 2024
111 of 112 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:API Airflow's REST/HTTP API area:dev-tools area:production-image Production image improvements and fixes kind:documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

7 participants