opolis/deployer

Infrastructure as Code

opolis/deployer is a serverless continuous integration and deployment ("CI/CD") orchestrator for services built on AWS. It allows your service's build, test, and deployment lifecycle to be completely defined as code, and live right alongside the service implementation. This allows the lifecycle to be completely automated, tested in isolation from other deployments of the same service, and most importantly, reliable.

Inspired by the ideas presented at awesome-codepipeline-ci

Please note these docs are still very much a work in progress. Let us know where there are gaps, or where more clarification is needed by opening an issue!

Created with ❤️ at Opolis in Colorado.

Please note, this project is still under active development and breaking changes in this version will occur until the project is considered stable and has reached 1.0.0

Overview

For a high-level overview of how opolis/deployer works, see docs/overview.md.

Getting Started

Before setting up opolis/deployer in your AWS account, it's important to know that it doesn't make any assumptions about your architecture. For it to be used effectively, it requires having in-depth knowledge of your deployment architecture, how various components integrate with one another, and how those components share resources. opolis/deployer simply provides a framework and set of conventions to take that knowledge, and turn it into a repeatable and reliable process.

At a minimum, opolis/deployer assumes you are using GitHub, deploying to AWS, and have a basic working knowledge of CloudFormation. If you haven't spent much time with CloudFormation, don't worry, we try to explain the high-level concepts where appropriate in the examples.

The CloudFormation Resource and Property Type Reference will be your best friend. Anything CloudFormation supports, opolis/deployer supports.

Prerequisites

• aws CLI utility
• docker daemon
• make

Configure aws

Add a profile to $HOME/.aws/credentials that will serve as your opolis/deployer deployment identity in AWS. This should be a set of access credentials that have administrator privileges. It's a good idea to rotate this key on a regular basis. Access keys can be created at the IAM console.

[opolis-deployer]
aws_access_key_id = AKIA...
aws_secret_access_key = O4vew...
region = <any valid region> # i.e. us-west-2
output = json

Please note that your choice of deployment region should be made based on what AWS services are available there. At the minimum, it must support CodePipeline, CodeBuild, and CloudFormation. If you have an idea for what services you'd like to use in your application, have a look at the Region Table for a list of what's available in each region.

Clone

For now, the primary deployment mechanism is from a local clone of this repository.

$ git clone git@github.com:opolis/deployer.git

Install

Build the Docker image that will provide a runtime environment for fetching dependencies and the serverless deployment.

$ make image

Build

Fetch dependencies

$ make deps

Build each Lambda function

$ make build

Configure opolis/deployer

opolis/deployer needs two secret keys to interact with GitHub. These secrets are stored on AWS SSM, and encrypted with a key from KMS. The easiest way to set and read these keys on AWS is to use opolis-config. Please install before continuing.

Key	Description
opolis.github.token	GitHub OAuth token with repo scope
opolis.github.hmac	GitHub HMAC key used in webhook configuration

opolis.github.token

1. Create an encryption key on KMS and make note of the ID (e.g. adad8b59-c518-40e0-8039-f91fca167833)
2. Obtain an OAuth token from GitHub with repo scope.
3. Use opolis-config to store it securely

$ opolis-deployer-config --profile opolis-deployer set opolis.github.token <your-aws-kms-key-id>

opolis.github.hmac

Create a random 64 character hex string to use as your webhook HMAC key. GitHub will use this key to sign all outgoing webhook payloads, and opolis/deployer will use it to validate the authenticity of the webhook by checking the signature.

Any means of doing this is satisfactory, but if you want a quick solution, copy the value created from,

$ ./cli/random.sh

opolis-deployer-config --profile opolis-deployer set opolis.github.hmac <your-aws-kms-key-id>

Deploy

Deploy the entire stack defined in serverless.yml

$ make deploy

NOTE: This can be used for updating opolis/deployer as well. Simply pull the latest version of the repo, rebuild, and rerun this command.

Serverless: Packaging service...
Serverless: Excluding development dependencies...
Serverless: Creating Stack...
Serverless: Checking Stack create progress...
.....
Serverless: Stack create finished...
Serverless: Uploading CloudFormation file to S3...
Serverless: Uploading artifacts...
Serverless: Uploading service opolis-deployer.zip file to S3 (59.32 MB)...
Serverless: Validating template...
Serverless: Updating Stack...
Serverless: Checking Stack update progress...
..........................................................................................
Serverless: Stack update finished...
Service Information
service: opolis-deployer
stage: prod
region: us-west-2
stack: opolis-deployer-prod
resources: 30
api keys:
  None
endpoints:
  POST - https://xxxxxxx.execute-api.us-west-2.amazonaws.com/prod/webhook <---- API GATEWAY ENDPOINT
functions:
  listener: opolis-deployer-prod-listener
  builder: opolis-deployer-prod-builder
  notifier: opolis-deployer-prod-notifier
  s3cleaner: opolis-deployer-prod-s3cleaner
  s3deployer: opolis-deployer-prod-s3deployer
  stack-cleaner: opolis-deployer-prod-stack-cleaner
layers:
  None

Make note of the API Gateway endpoint above. This will be used to configure the webhook endpoint on your GitHub repositories.

Adding a Repository

In order for a push to a GitHub repository to be processed by opolis/deployer, you must first configure a webhook for your target repo and add the required files. See Adding a Repository.

Let's Go!

Now that opolis/deployer has been deployed to your AWS account, you are ready to start writing some CloudFormation templates for your services. Take a look at the examples to see what's possible.

Loose Ends

Doesn't AWS have a product that does this already?

Yes and no. CloudFormation, CodeBuild, and CodePipeline provide the majority of the heavy lifting opolis/deployer doesn't do itself, but there are certain properties we wanted our deployments to have, like unlimited isolated deployments, that we weren't getting with those products on their own.

According to the CodePipeline Concepts document,

Multiple revisions can be processed in the same pipeline, but each stage can process only one revision at a time.

This means that even if we can push several branches/revisions through a single pipeline, these revisions cannot be processed in parallel, effectively putting a hard cap on your team's lifecycle throughput. opolis/deployer fixes this by automating the provisioning of a new CodePipeline for each branch created. The only pipelines that are reused are staging (for the master branch), and production (for tagged releases).

So, hopefully CodePipeline will incorporate some kind of parallel pipeline processing for the same template in the near future, but until that happens, opolis/deployer will continue to fill in that gap.

Limitations

• AWS limits the total number of CodePipeline instances in your account to 300 in any given region. If you have hundreds of developers pushing multiple branches per day for testing, you may hit this limit. Ideally, opolis/deployer would utilize multiple regions at once, making this limit 1200 for all supported US and 1200 for all supported EU regions. Let's work together to figure out a solution!

License

Licensed under the MIT License and available for all.