Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parallelize client and server builds in dockerfile #11161

Merged
merged 3 commits into from
Jan 19, 2021

Conversation

nuwang
Copy link
Member

@nuwang nuwang commented Jan 17, 2021

This PR modifies the k8s docker file so that client and server build stages are built in parallel, reducing total build time.

The uncached build time prior to this is ~18.5 minutes locally, which reduces to ~12.5 minutes, a ~33% reduction.
On dockerhub, there appears to be no benefit, as the builds don't seem to be parallelised in the free version.

This PR is dependent on: galaxyproject/ansible-galaxy#120

@github-actions github-actions bot added this to the 21.05 milestone Jan 17, 2021
.k8s_ci.Dockerfile Show resolved Hide resolved
.k8s_ci.Dockerfile Show resolved Hide resolved
Copy link
Member

@mvdbeek mvdbeek left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@nuwang
Copy link
Member Author

nuwang commented Jan 18, 2021

@mvdbeek @dannon I've added a docker build hook that should enable parellelization on hub. Have also preserved node. Thanks for reviewing.

@nuwang
Copy link
Member Author

nuwang commented Jan 18, 2021

It may make sense to include this in 21.01 as well, since it could significantly speed up build times?

@mvdbeek
Copy link
Member

mvdbeek commented Jan 18, 2021

No problem, I will backport it.

@mvdbeek mvdbeek merged commit f67dce1 into galaxyproject:dev Jan 19, 2021
@github-actions
Copy link

This PR was merged without a "kind/" label, please correct.

@nuwang nuwang deleted the parallelize_server_client_build branch January 26, 2021 11:01
@mvdbeek mvdbeek modified the milestones: 21.05, 21.01 Mar 10, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants