[Bugfix] Ensure replacement check

CHANGELOG.md

@@ -25,6 +25,7 @@
 - (Feature) Set Logger format
 - (Bugfix) Ensure Wait actions to be present after AddMember
 - (Documentation) Refactor metrics (Part 1)
+- (Bugfix) Extend Agency HealthCheck for replace
 
 ## [1.2.13](https://github.com/arangodb/kube-arangodb/tree/1.2.13) (2022-06-07)
 - (Bugfix) Fix arangosync members state inspection

docs/generated/metrics/README.md

@@ -2,8 +2,15 @@
 
 ## List
 
-|                                   Name                                    |     Namespace     | Group  | Type  | Description                                |
-|:-------------------------------------------------------------------------:|:-----------------:|:------:|:-----:|:-------------------------------------------|
-|  [arangodb_operator_agency_errors](./arangodb_operator_agency_errors.md)  | arangodb_operator | agency | Count | Current count of agency cache fetch errors |
-| [arangodb_operator_agency_fetches](./arangodb_operator_agency_fetches.md) | arangodb_operator | agency | Count | Current count of agency cache fetches      |
-|   [arangodb_operator_agency_index](./arangodb_operator_agency_index.md)   | arangodb_operator | agency | Gauge | Current index of the agency cache          |
+|                                                      Name                                                       |     Namespace     |    Group     | Type  | Description                                        |
+|:---------------------------------------------------------------------------------------------------------------:|:-----------------:|:------------:|:-----:|:---------------------------------------------------|
+|                     [arangodb_operator_agency_errors](./arangodb_operator_agency_errors.md)                     | arangodb_operator |    agency    | Count | Current count of agency cache fetch errors         |
+|                    [arangodb_operator_agency_fetches](./arangodb_operator_agency_fetches.md)                    | arangodb_operator |    agency    | Count | Current count of agency cache fetches              |
+|                      [arangodb_operator_agency_index](./arangodb_operator_agency_index.md)                      | arangodb_operator |    agency    | Gauge | Current index of the agency cache                  |
+|       [arangodb_operator_agency_cache_health_present](./arangodb_operator_agency_cache_health_present.md)       | arangodb_operator | agency_cache | Gauge | Determines if local agency cache health is present |
+|              [arangodb_operator_agency_cache_healthy](./arangodb_operator_agency_cache_healthy.md)              | arangodb_operator | agency_cache | Gauge | Determines if agency is healthy                    |
+|              [arangodb_operator_agency_cache_leaders](./arangodb_operator_agency_cache_leaders.md)              | arangodb_operator | agency_cache | Gauge | Determines agency leader vote count                |
+| [arangodb_operator_agency_cache_member_commit_offset](./arangodb_operator_agency_cache_member_commit_offset.md) | arangodb_operator | agency_cache | Gauge | Determines agency member commit offset             |
+|       [arangodb_operator_agency_cache_member_serving](./arangodb_operator_agency_cache_member_serving.md)       | arangodb_operator | agency_cache | Gauge | Determines if agency member is reachable           |
+|              [arangodb_operator_agency_cache_present](./arangodb_operator_agency_cache_present.md)              | arangodb_operator | agency_cache | Gauge | Determines if local agency cache is present        |
+|              [arangodb_operator_agency_cache_serving](./arangodb_operator_agency_cache_serving.md)              | arangodb_operator | agency_cache | Gauge | Determines if agency is serving                    |

docs/generated/metrics/arangodb_operator_agency_cache_health_present.md

@@ -0,0 +1,12 @@
+# arangodb_operator_agency_cache_health_present (Gauge)
+
+## Description
+
+Determines if local agency cache health is present
+
+## Labels
+
+|   Label   | Description          |
+|:---------:|:---------------------|
+| namespace | Deployment Namespace |
+|   name    | Deployment Name      |

docs/generated/metrics/arangodb_operator_agency_cache_healthy.md

@@ -0,0 +1,12 @@
+# arangodb_operator_agency_cache_healthy (Gauge)
+
+## Description
+
+Determines if agency is healthy
+
+## Labels
+
+|   Label   | Description          |
+|:---------:|:---------------------|
+| namespace | Deployment Namespace |
+|   name    | Deployment Name      |

docs/generated/metrics/arangodb_operator_agency_cache_leaders.md

@@ -0,0 +1,13 @@
+# arangodb_operator_agency_cache_leaders (Gauge)
+
+## Description
+
+Determines agency leader vote count. Should be always one
+
+## Labels
+
+|   Label   | Description          |
+|:---------:|:---------------------|
+| namespace | Deployment Namespace |
+|   name    | Deployment Name      |
+|   agent   | Agent ID             |

docs/generated/metrics/arangodb_operator_agency_cache_member_commit_offset.md

@@ -0,0 +1,13 @@
+# arangodb_operator_agency_cache_member_commit_offset (Gauge)
+
+## Description
+
+Determines agency member commit offset. Set to -1 if Agent is not reachable
+
+## Labels
+
+|   Label   | Description          |
+|:---------:|:---------------------|
+| namespace | Deployment Namespace |
+|   name    | Deployment Name      |
+|   agent   | Agent ID             |

docs/generated/metrics/arangodb_operator_agency_cache_member_serving.md

@@ -0,0 +1,13 @@
+# arangodb_operator_agency_cache_member_serving (Gauge)
+
+## Description
+
+Determines if agency member is reachable
+
+## Labels
+
+|   Label   | Description          |
+|:---------:|:---------------------|
+| namespace | Deployment Namespace |
+|   name    | Deployment Name      |
+|   agent   | Agent ID             |

docs/generated/metrics/arangodb_operator_agency_cache_present.md

@@ -0,0 +1,12 @@
+# arangodb_operator_agency_cache_present (Gauge)
+
+## Description
+
+Determines if local agency cache is present
+
+## Labels
+
+|   Label   | Description          |
+|:---------:|:---------------------|
+| namespace | Deployment Namespace |
+|   name    | Deployment Name      |

docs/generated/metrics/arangodb_operator_agency_cache_serving.md

@@ -0,0 +1,12 @@
+# arangodb_operator_agency_cache_serving (Gauge)
+
+## Description
+
+Determines if agency is serving
+
+## Labels
+
+|   Label   | Description          |
+|:---------:|:---------------------|
+| namespace | Deployment Namespace |
+|   name    | Deployment Name      |

go.mod

@@ -28,6 +28,7 @@ require (
 	github.com/arangodb/go-driver v1.2.1
 	github.com/arangodb/go-driver/v2 v2.0.0-20211021031401-d92dcd5a4c83
 	github.com/arangodb/go-upgrade-rules v0.0.0-20180809110947-031b4774ff21
+	github.com/arangodb/rebalancer v0.1.1
 	github.com/cenkalti/backoff v2.2.1+incompatible
 	github.com/dchest/uniuri v0.0.0-20160212164326-8902c56451e9
 	github.com/gin-gonic/gin v1.7.2

internal/metrics.yaml

@@ -5,6 +5,76 @@ destination: pkg/generated/metric_descriptions
 
 namespaces:
   arangodb_operator:
+    agency_cache:
+      present:
+        shortDescription: "Determines if local agency cache is present"
+        description: "Determines if local agency cache is present"
+        type: "Gauge"
+        labels:
+          - key: namespace
+            description: "Deployment Namespace"
+          - key: name
+            description: "Deployment Name"
+      health_present:
+        shortDescription: "Determines if local agency cache health is present"
+        description: "Determines if local agency cache health is present"
+        type: "Gauge"
+        labels:
+          - key: namespace
+            description: "Deployment Namespace"
+          - key: name
+            description: "Deployment Name"
+      serving:
+        shortDescription: "Determines if agency is serving"
+        description: "Determines if agency is serving"
+        type: "Gauge"
+        labels:
+          - key: namespace
+            description: "Deployment Namespace"
+          - key: name
+            description: "Deployment Name"
+      healthy:
+        shortDescription: "Determines if agency is healthy"
+        description: "Determines if agency is healthy"
+        type: "Gauge"
+        labels:
+          - key: namespace
+            description: "Deployment Namespace"
+          - key: name
+            description: "Deployment Name"
+      member_serving:
+        shortDescription: "Determines if agency member is reachable"
+        description: "Determines if agency member is reachable"
+        type: "Gauge"
+        labels:
+          - key: namespace
+            description: "Deployment Namespace"
+          - key: name
+            description: "Deployment Name"
+          - key: agent
+            description: "Agent ID"
+      member_commit_offset:
+        shortDescription: "Determines agency member commit offset"
+        description: "Determines agency member commit offset. Set to -1 if Agent is not reachable"
+        type: "Gauge"
+        labels:
+          - key: namespace
+            description: "Deployment Namespace"
+          - key: name
+            description: "Deployment Name"
+          - key: agent
+            description: "Agent ID"
+      leaders:
+        shortDescription: "Determines agency leader vote count"
+        description: "Determines agency leader vote count. Should be always one"
+        type: "Gauge"
+        labels:
+          - key: namespace
+            description: "Deployment Namespace"
+          - key: name
+            description: "Deployment Name"
+          - key: agent
+            description: "Agent ID"
     agency:
       index:
         shortDescription: "Current index of the agency cache"