buildkite-stack

This is a pretty basic buildkite agent stack which starts a fixed number of agents using either on demand or spot pricing.

It is comprised of:

• AWS Cloudformation
• coffer
• buildkite agent
• buildkite-packer

usage

• Use buildkite-packer to build an AMI in your AWS account, once this is done use this in the cloudformation.

• Create a KMS key in the region your using with the alias coffer.

• Create an S3 bucket to hold the coffer files.

• Setup an ssh key and put it in your coffer file.

files:
  "/var/lib/buildkite-agent/.ssh/id_rsa":
    mode: 0600
    content: |
        -----BEGIN RSA PRIVATE KEY-----
        ...
        -----END RSA PRIVATE KEY-----

• Encrypt and upload the coffer file

AWS_PROFILE=XX AWS_REGION=ap-southeast-2 coffer --coffer-file buildkite.coffer upload --bucket="XX-buildkite-coffers"

• Run the create stack passing in the required parameters.

AWS_DEFAULT_PROFILE=XX AWS_DEFAULT_REGION=ap-southeast-2 ./create-stack.sh \
    Subnets="subnet-XX,subnet-XX" AMIID="ami-XX" CofferKeyARN="arn:aws:kms:ap-southeast-2:XXX:key/XXX" \
    AgentToken="XXX" ArtifactsS3BucketName="XX-buildkite-artifacts" \
    CofferS3BucketName="XX-buildkite-coffers" VpcId=vpc-XX AgentMetaData="gophers=true" \
    EC2KeyName="XX-buildkite-agent"

Sponsor

This project was made possible by Versent.

License

BSD