Skip to content

Comments

GitHub PROD image build is pushed to GitHub Registry.#13442

Merged
potiuk merged 1 commit intoapache:masterfrom
PolideaInternal:prod-build-image-pulled
Jan 4, 2021
Merged

GitHub PROD image build is pushed to GitHub Registry.#13442
potiuk merged 1 commit intoapache:masterfrom
PolideaInternal:prod-build-image-pulled

Conversation

@potiuk
Copy link
Member

@potiuk potiuk commented Jan 2, 2021

One of the earlier changes removed unneccessary pulling of the
'build' segment from GitHub Registry in `ci_wait_for_prod_image.sh'.
It is not needed, because the K8S tests only use the final image
and pulling the build image is not necessary.

This has the undesired effect that 'ci_wait_for_prod_image.sh' was
also used at the step where master image pushes the prod image
to the repository as the 'latest' cache. In this case both - the
'final' prod image and the 'build' segment should be pulled,
because both are needed for PROD image build optimizations.


^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.

@potiuk potiuk force-pushed the prod-build-image-pulled branch from 51d79d4 to 9cb7033 Compare January 3, 2021 11:22
@potiuk
Copy link
Member Author

potiuk commented Jan 3, 2021

This fixes the final problem that none of the master builds succeeded recently. Pushing images to cache in master build failed because the PROD build images were not pulled and pushing them to GitHub cache failed in master. That's also a reason why building PROD images now takes a lot more time, because GitHub Cache for those is rather old (two weeks or so)

@potiuk potiuk added this to the Airflow 2.0.1 milestone Jan 3, 2021
One of the earlier changes removed unneccessary pulling of the
'build' segment from GitHub Registry in `ci_wait_for_prod_image.sh'.
It is not needed, because the K8S tests only use the final image
and pulling the build image is not necessary.

This has the undesired effect that 'ci_wait_for_prod_image.sh' was
also used at the step where master image pushes the prod image
to the repository as the 'latest' cache. In this case both - the
'final' prod image and the 'build' segment should be pulled,
because both are needed for PROD image build optimizations.
@potiuk potiuk force-pushed the prod-build-image-pulled branch from 9cb7033 to ae719a1 Compare January 3, 2021 20:52
@potiuk potiuk merged commit 35e4a3b into apache:master Jan 4, 2021
@potiuk potiuk deleted the prod-build-image-pulled branch January 4, 2021 07:21
kaxil pushed a commit that referenced this pull request Jan 21, 2021
One of the earlier changes removed unneccessary pulling of the
'build' segment from GitHub Registry in `ci_wait_for_prod_image.sh'.
It is not needed, because the K8S tests only use the final image
and pulling the build image is not necessary.

This has the undesired effect that 'ci_wait_for_prod_image.sh' was
also used at the step where master image pushes the prod image
to the repository as the 'latest' cache. In this case both - the
'final' prod image and the 'build' segment should be pulled,
because both are needed for PROD image build optimizations.

(cherry picked from commit 35e4a3b)
kaxil pushed a commit to astronomer/airflow that referenced this pull request Apr 23, 2021
One of the earlier changes removed unneccessary pulling of the
'build' segment from GitHub Registry in `ci_wait_for_prod_image.sh'.
It is not needed, because the K8S tests only use the final image
and pulling the build image is not necessary.

This has the undesired effect that 'ci_wait_for_prod_image.sh' was
also used at the step where master image pushes the prod image
to the repository as the 'latest' cache. In this case both - the
'final' prod image and the 'build' segment should be pulled,
because both are needed for PROD image build optimizations.

(cherry picked from commit 35e4a3b)
(cherry picked from commit 7a555ff)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants