Emergency contact (for senior folk)

[PatReynolds]

This is for the senior people to alert those people who can do something about it, that there is a major incident (e.g. a website is down).
Create Slack list and protocol for its use
Emergency contact list (emails) and protocol for its use
Possibly Involve google analytics- to send automatic alert to slack.

[Captainkirkdawson]

Deeply puzzled by this story. There is already an automatic system that is monitoring all of the servers and apps in quite a bit of detail. Reports of failures are sent to the slack alerts channel. They are also sent to Lemon and I believe to Barry; Lemon offered to have them come to me but I declined. Lemon will normally take action to resolve the issue. If significant he posts to the tech list.

The last reported alert was November 23
Nagios APP [7:34 AM]
[PROBLEM] brazza/root disk WARNING
Nagios APP [7:59 AM]
[PROBLEM] brazza/root disk CRITICAL
[7:59]
[PROBLEM] brazza/mongodb disk WARNING
[8:04]
[RECOVERY] brazza/root disk OK
[8:04]
[RECOVERY] brazza/mongodb disk OK

[PatReynolds]

This is something different: the automatic system is needed, and works really well (if the absence of downtime on our websites is anything to go by). What we need is a way to communicate with the people who can put in place the softer side of solutions, should anything go wrong - e.g. putting a notice on the login page so that if one server is down, volunteers will understand why sometimes they can login, but sometimes can't, putting a message on social media if a website is down.

[Captainkirkdawson]

That is a very different story, It is one of the roles that I used to play

[Captainkirkdawson]

I continue to find no specific system requirement