New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Wire up promotion logic between new CI pipeline stages #7043
Merged
Merged
Changes from all commits
Commits
Show all changes
19 commits
Select commit
Hold shift + click to select a range
d217c13
Add metadata that will be used for the manifest, update required meta…
scotthain 0d8141e
Extract a Set-TargetMetadata Powershell function
christophermaier 19c193a
Fix whitespace
christophermaier 40b5c83
Cleanup create_manifest.rb a bit
christophermaier 898d82c
Split promote_packages.sh into separate scripts
christophermaier 797a11c
Remove unnecessary promotion step when building packages
christophermaier 00f7cda
Clarify usage of HAB_BLDR_CHANNEL in powershell script
christophermaier 3786ab3
Remove Install-BuildkiteAgent function
christophermaier 8782ea4
Remove redundant SSL_CERT_FILE declaration
christophermaier ebee9d8
Add version to manifest.json
christophermaier 792defc
Add a bunch of shared helper functions
christophermaier 95648ee
Simplify the package_and_upload_binary.sh script
christophermaier c981fa1
Promote to dev channel after release
christophermaier 07d60a7
Promote from dev to acceptance after end-to-end pipeline
christophermaier 71662a9
Add Git SHA to manifest
christophermaier 46a5e94
Set paranoia=maximum
christophermaier 13583b8
Remove workaround for Issue 6771
christophermaier 933ec17
Don't need to store the macOS artifact in Buildkite anymore
christophermaier f2810d7
Only promote for Expeditor-triggered pipeline runs
christophermaier File filter
Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,70 @@ | ||
| #!/bin/bash | ||
|
|
||
| # Retrieves the current package manifest for a particular environment | ||
| # and promotes the packages into a designated Builder channel. Also | ||
| # promotes all artifacts in S3 to the designated destination | ||
| # environment. | ||
| # | ||
| # We promote to Builder *before* promoting in S3 because it's | ||
| # safer. If the final S3 promotion were to fail, we'd still have good | ||
| # and self-consistent packages in Builder for all to use. If we did S3 | ||
| # first, but the following Builder promotion failed for some reason, | ||
| # people getting packages from our "curlbash" installer would get a | ||
| # new `hab`, but wouldn't be able to get the rest of the packages | ||
| # (easily, anyway), because they wouldn't have yet made it to the | ||
| # stable channel. | ||
|
|
||
| set -euo pipefail | ||
|
|
||
| # `source_environment` is the Expeditor environment from which to pull | ||
| # a manifest.json file from in order to drive the promotions. | ||
| # | ||
| # e.g., "dev", "acceptance", etc. | ||
| source_environment=${1:?You must provide an Expeditor environment} | ||
|
|
||
| # `destination_channel` should be the channel we are promoting Habitat | ||
| # packages into. | ||
| # | ||
| # e.g. `acceptance`, `current`, etc | ||
| destination_channel=${2:?You must specify a destination channel value} | ||
|
|
||
| export HAB_AUTH_TOKEN="${ACCEPTANCE_HAB_AUTH_TOKEN}" | ||
| export HAB_BLDR_URL="${ACCEPTANCE_HAB_BLDR_URL}" | ||
|
|
||
| ######################################################################## | ||
|
|
||
| source .expeditor/scripts/shared.sh | ||
|
|
||
| # This allows people to e.g. trigger end-to-end pipeline runs manually | ||
| # when iterating on tests, but without having to fear that they'll | ||
| # inadvertently promote a set of artifacts accidentally. | ||
| # | ||
| # Only Chef Expeditor should be triggering "real" runs of pipelines | ||
| # that use this script. | ||
| valid_build_creator="Chef Expeditor" | ||
|
|
||
| if [[ "${BUILDKITE_BUILD_CREATOR}" == "${valid_build_creator}" ]]; then | ||
| # We're in a real pipeline run; let's promote! | ||
|
|
||
| # Take advantage of the fact that we're just promoting and we can run | ||
| # 100% on linux | ||
| declare -g hab_binary | ||
| curlbash_hab "x86_64-linux" | ||
|
|
||
| # Needed for validation of the downloaded manifest | ||
| import_gpg_keys | ||
|
|
||
| echo "--- Retrieving manifest.json for ${source_environment} environment" | ||
| get_manifest_for_environment "${source_environment}" | ||
|
|
||
| # Extract the targets from the manifest | ||
| echo "--- Promoting Habitat packages into the ${destination_channel} channel on ${HAB_BLDR_URL}" | ||
| promote_packages_to_builder_channel manifest.json "${destination_channel}" | ||
|
|
||
| version="$(jq -r '.version' < manifest.json)" | ||
| echo "--- Promoting binary packages and manifest to the ${destination_channel} channel in S3" | ||
| promote_version_in_s3 "${version}" "${destination_channel}" | ||
|
|
||
| else | ||
| echo "--- NOT PROMOTING: Build triggered by ${BUILDKITE_BUILD_CREATOR} and *not* ${valid_build_creator}" | ||
| fi |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Education for myself and our fellow readers: the intent of how we release is that everything that passes e2e testing makes it to acceptance. It's the channels downstream of that that require a human to make a decision on when to promote. Correct?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yup