reef: mgr/dashboard: Show the OSDs Out and Down panels as red whenever an OSD is in Out or Down state in Ceph Cluster grafana dashboard

[aaSharma14]

backport tracker: https://tracker.ceph.com/issues/63571

---

backport of #53650
parent tracker: https://tracker.ceph.com/issues/62969

this backport was staged using ceph-backport.sh version 16.0.0.6848
find the latest version at https://github.com/ceph/ceph/blob/main/src/script/ceph-backport.sh

[Ejdesgaard]

I just tried to import the changes and "all" is not green

Also, it looks like the thresholds are based on %, that doesn't work across the scaling.
red being 10% of a 24 osd cluster is too low and 10% of a 1000 osd cluster is too high.
Using an integer value instead would be much better. The simple values could be all-1 = yellow and all-2 is red
The better one would be all-1 = yellow and all-( ( osd.count/node.count )-1 ) = red

[cloudbehl]

@Ejdesgaard The reason for the change is that we have alerts as well which uses the exact same value across cluster, if its a smaller cluster or a bigger one. This panel should reflect the same and thats what we try to do with thrash holds. Another reason, Grafana doesn't allow complex calculations for thresholds. Its by percentage or by exact value

If we want to change the logic then the fix also need to be in OSD alerts.