Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Follow-up from Week 3 site incident #2464

Closed
gregmarra opened this issue Mar 17, 2019 · 2 comments

Comments

Projects
None yet
1 participant
@gregmarra
Copy link
Contributor

commented Mar 17, 2019

  1. Increase daily quota, verify monthly quota
  2. Ensure key developers have permissions to fix issues
  3. Get resolution from Google on GAE settings errors
  4. Establish a technical contact at Google to escalate future technical issues?
  5. iOS app crashes on launch when server is down.
@gregmarra

This comment has been minimized.

Copy link
Contributor Author

commented Mar 17, 2019

Discussion ongoing in #site-down on slack.

@gregmarra

This comment has been minimized.

Copy link
Contributor Author

commented Mar 17, 2019

Site came back up as anticipated when budget reset at midnight PST.

  1. Daily quota was increased from $20 to $100 per day. We peak on Saturdays, and this was the first time we hit $20. We have a notification set up if our monthly expenses cross $500, $900, and $1000 , which will trigger an email notification to me. Additional followup in #2466.

  2. @fangeugene now has permissions that will allow him to change the daily App Engine quota budget.

  3. Do not know why GAE budget editing was erroring, created #2467 .

  4. I'm going to send an email to a contact at Google.

  5. Fixed in the-blue-alliance/the-blue-alliance-ios@c0de9ac

@gregmarra gregmarra closed this Mar 17, 2019

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.