Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add alarms for UIs being unavailable. #497

Merged
merged 4 commits into from
Oct 29, 2020
Merged

Conversation

adunkman
Copy link
Contributor

To achieve part of #250, this will notify SNS when the public UI or authenticated UI are unavailable. Subscriptions for alertees can be manually managed through the AWS console.

  • Ran the account-specific step in the staging AWS account already to test.
  • Kicked off a deploy to develop to test in that environment, but I think the develop environment hasn’t been fixed since blue/green deployments were introduced. I’ll take a look in the morning, but here’s the diff for review in the meantime!

Will notifiy SNS when the public UI or authenticated UI are unavailable.
Copy link
Contributor

@julialeague julialeague left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@adunkman
Copy link
Contributor Author

🎵 Du dud dud udu duuu dudud du dudu dudu dud uduu 🎵

CircleCI caught that we need to add permissions to the deployer for route53:CreateHealthCheck — following up with a commit here to adjust those permissions.

Route53 health checks are used to monitor the system; this PR allows the
CircleCI deployer to add, remove, modify, list them.
Copy link
Contributor

@julialeague julialeague left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"the system is down..."

The previous descriptions were not helpful across environments.
@adunkman
Copy link
Contributor Author

Okay, finally got this sorted out — the timeframe for alarms must be 60 seconds or longer for AWS metrics, and I tweaked the alarm name after seeing them in the console, as the alarm dashboard didn’t indicate which environment the alarms are attached to.

This is ready for final review/merge.

@adunkman adunkman self-assigned this Oct 28, 2020
Copy link
Contributor

@julialeague julialeague left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mmarcotte, I recommend you accept this PR into the court environments. Thanks!

@mmarcotte mmarcotte merged commit bb97d4b into staging Oct 29, 2020
@adunkman adunkman deleted the alarms-configuration branch October 29, 2020 16:44
@adunkman adunkman mentioned this pull request Oct 30, 2020
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants