Skip to content

Comments

Push PROD image cache for all python versions#30156

Merged
potiuk merged 1 commit intoapache:mainfrom
potiuk:speed-up-prod-image-builds
Mar 16, 2023
Merged

Push PROD image cache for all python versions#30156
potiuk merged 1 commit intoapache:mainfrom
potiuk:speed-up-prod-image-builds

Conversation

@potiuk
Copy link
Member

@potiuk potiuk commented Mar 16, 2023

The PROD image cache is not as crucial as CI image cache but it can still improve time of building the image. We had a bug in our CI actions that cache pushing only worked for default Python version.

This means that most PRs were ok, but the PRs that run full set of tests run a bit slower as PROD image was building for a longer time.

Adding --run-in-parallel flag should bring cache back for PROD image for all Python versions.


^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

The PROD image cache is not as crucial as CI image cache but it can
still improve time of building the image. We had a bug in our CI
actions that cache pushing only worked for default Python version.

This means that most PRs were ok, but the PRs that run full set
of tests run a bit slower as PROD image was building for a longer
time.

Adding --run-in-parallel flag should bring cache back for PROD
image for all Python versions.
@potiuk
Copy link
Member Author

potiuk commented Mar 16, 2023

This will only show up in main merging now.

@potiuk potiuk merged commit a3996c0 into apache:main Mar 16, 2023
@potiuk potiuk deleted the speed-up-prod-image-builds branch March 16, 2023 21:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants