Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reorder pipeline stages for maximum parallelism #7077

Merged
merged 1 commit into from Oct 22, 2019

Conversation

@christophermaier
Copy link
Contributor

christophermaier commented Oct 22, 2019

While the windows-service package must be built after the Windows
Launcher package, there is nothing that prevents Launcher and
Supervisor packages from being built in parallel, since they are
mutually independent on a Habitat dependency level.

Similarly, none of the exporters depend directly on either the
Launcher or the Supervisor, so they can all be built at the same time
as those two packages.

Now, we build the Windows Service toward the end, alongside the
core/hab-pkg-cfize exporter, which itself has a hard dependency on
core/hab-pkg-export-docker.

By reordering these and building more packages in parallel, we should
be able to get through the entire pipeline in less overall time.

Signed-off-by: Christopher Maier cmaier@chef.io

While the `windows-service` package must be built after the Windows
Launcher package, there is nothing that prevents Launcher and
Supervisor packages from being built in parallel, since they are
mutually independent on a Habitat dependency level.

Similarly, none of the exporters depend directly on either the
Launcher or the Supervisor, so they can all be built at the same time
as those two packages.

Now, we build the Windows Service toward the end, alongside the
`core/hab-pkg-cfize` exporter, which itself has a hard dependency on
`core/hab-pkg-export-docker`.

By reordering these and building more packages in parallel, we should
be able to get through the entire pipeline in less overall time.

Signed-off-by: Christopher Maier <cmaier@chef.io>
@christophermaier christophermaier requested review from smacfarlane and mwrock Oct 22, 2019
@christophermaier christophermaier self-assigned this Oct 22, 2019
@mwrock
mwrock approved these changes Oct 22, 2019
@christophermaier christophermaier merged commit c185b9f into master Oct 22, 2019
5 checks passed
5 checks passed
DCO This commit has a DCO Signed-off-by
Details
buildkite/habitat-sh-habitat-master-verify Build #3824 passed (45 minutes, 1 second)
Details
buildkite/habitat-sh-habitat-master-website Build #908 passed (43 seconds)
Details
continuous-integration/travis-ci/pr The Travis CI build passed
Details
expeditor/config-validation Validated your Expeditor config file
Details
@chef-expeditor chef-expeditor bot deleted the cm/pipeline-reordering branch Oct 22, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
2 participants
You can’t perform that action at this time.