Add monitoring service

[vranki]

New service request: Monitoring service

Minimum specs:

• Add websites to a list
• Service polls the websites regularly. If site is down, it'll notify on matrix and e-mail, as configured

I have no opinion on which application to use, there are many.

[vranki]

Jyväskylä has already one set up, and could be used by setting in DNS icinga.hacklab.fi CNAME jkl.hacklab.fi

[olmari]

Jyväskylä has already one set up, and could be used by setting in DNS icinga.hacklab.fi CNAME jkl.hacklab.fi

That has been the plan to utilize.

[tswfi]

for those who have not even heard about icinga :D

https://icinga.com/demo/authentication/login
demo / demo

Looks decent after a quick click through. But I din't see any graphs (for example load averages / network traffic)...

[zouppen]

And of course we need to add the services there, too. It supports checking service status over ssh, too. Way to go would be to poll externally + check server load, disk etc. regularly. I would like to share knowledge so if any of you are interested in learning to admin icinga, please tell me :)

[zouppen]

Somes screenshots from our current setup. Overview:

Service history:

[olmari]

I'm interested ot learn in general.. need to have basic knowledge to be any use :D

[vranki]

Icinga seems to support Matrix notifications: https://exchange.icinga.com/denny/icinga2-notification-matrixorg

[zouppen]

I have implemented Matrix notifications by myself (before that script was even done or I was aware of that) so they are already supported on our server. Here's full list of supported, already configured notification routes:

• E-mail
• Matrix private messages and rooms
• IRC private messages and channels (via Matrix)
• Telegram channels (via bridging to Matrix)

E-mail notifications depend on Exim SMTP server health and Matrix notifications depend on Synapse Matrix server of Hacklab Jyväskylä. Telegram notifications depend also on Mautrix-telegram instance of hacklab.fi on a different server. So special care should be taken when monitoring services which are requirements of these notifications. But in general I use both e-mail and Matrix notifications for myself to mitigate the issue when a specific gateway is down for any reason.