Skip to content

Commit

Permalink
new alert when error rate for a specific accout and plugin > 50%
Browse files Browse the repository at this point in the history
  • Loading branch information
dhalimi1975 committed May 24, 2024
1 parent bf4a346 commit ee37bc1
Showing 1 changed file with 13 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -40,6 +40,19 @@ groups:
annotations:
description: sending emails with aws ses relay high error rate greater than 50%
summary: sending emails with aws ses relay high error rate greater than 50%
- alert: SendingEmailsHighErrorRateByProjectProvider
expr: sum (sum_over_time(cronus_event_mails_sent_error_provider_rate_perminute[5m]) OR on() vector(0)) by (project_name, provider) / sum (sum_over_time(cronus_event_mails_sent_provider_rate_perminute[5m]) OR on() vector(0)) by (project_name, provider) > 0.5
for: 15m
labels:
service: email
severity: warning
tier: os
playbook: docs/devops/alert/cronus/#send_email
kibana: "app/discover#/?_g=(filters:!(),refreshInterval:(pause:!t,value:0),time:(from:now-5m,to:now))&_a=(columns:!(_source),filters:!(('$state':(store:appState),meta:(alias:!n,disabled:!f,index:'logstash-*',key:kubernetes_labels_name,negate:!f,params:(query:cronus),type:phrase),query:(match_phrase:(kubernetes_labels_name:cronus)))),index:'logstash-*',interval:auto,query:(language:kuery,query:'%22email%20delivery%20result%20%231:%20%5C%22aws%5C%22%20250%22'),sort:!())"
support_group: email
annotations:
description: sending emails from project: {{ $labels.project_name }} relay: {{ $labels.provider }} high error rate greater than 50%
summary: sending emails from project: {{ $labels.project_name }} relay: {{ $labels.provider }} high error rate greater than 50%
- alert: EmailHealthTest
expr: avg (cronus_health_test) by (name) == 0
for: 30m
Expand Down

0 comments on commit ee37bc1

Please sign in to comment.