Skip to content
This repository has been archived by the owner on Mar 6, 2023. It is now read-only.

CriticalDiskSpace Alert using wrong Metrics #275

Closed
jwhitcraft opened this issue Mar 25, 2020 · 0 comments · Fixed by #276
Closed

CriticalDiskSpace Alert using wrong Metrics #275

jwhitcraft opened this issue Mar 25, 2020 · 0 comments · Fixed by #276
Labels
bug Something isn't working

Comments

@jwhitcraft
Copy link

jwhitcraft commented Mar 25, 2020

What happened?
Today when looking at my some of my systems from the terminal I noticed that some were under 10% diskspace left on the mount point, but i was not getting an alert from promteheus for this.

Did you expect to see some different?
No

How to reproduce it (as minimally and precisely as possible):
I put this query into prometheus which is provided by the role:

node_filesystem_free_bytes{mountpoint!~"^/run(/.*|$)",fstype!~"(squashfs|fuse.*)",job="node"} / node_filesystem_size_bytes{job="node"} < 0.1 and only one item returned

but when I put this query into Promethus all the servers that had mount points below 10% came back (7 items):

node_filesystem_avail_bytes{filesystem!~"^/run(/|$)",fstype!~"(squashfs|fuse.*)",job="node"} / node_filesystem_size_bytes{filesystem!~"^/run(/|$)",job="node"} < 0.1

Environment

  • Role version:

    {install_date: 'Wed Mar 4 15:48:23 2020', version: 2.13.2}

  • Ansible version information:

ansible 2.7.16
config file = None
configured module search path = ['/Users/jwhitcraft/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
ansible python module location = /usr/local/lib/python3.7/site-packages/ansible
executable location = /usr/local/bin/ansible
python version = 3.7.6 (default, Dec 30 2019, 19:38:26) [Clang 11.0.0 (clang-1100.0.33.16)]

  • Variables:
no custom variable, just a standard install for prometheus
  • Ansible playbook execution Logs:
Just a standard install to test out things for this role with prometheus.

Anything else we need to know?:

Here is the output from prometheus:
Image 2020-03-25 at 8 42 23 AM

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant