DORA Stability Metrics Calculation

[jeffschaper]

How does DevLake calculate DORA stability metrics?

How would DevLake handle the following scenario:

My company uses ServiceNow to track Change Requests (CHG) and Incidents (INC) scoped to an Affected Configuration Item (CI). My company is currently using the PagerDuty data connection to obtain DORA stability metrics, but was noted in issue #8367, it does not allow us to filter for more granular information. Because of this, we are migrating from the PagerDuty connection over to webhooks so we can filter for the data we care about.

Someone asked me today if DevLake can associate failed CHG requests to the Change Failure Rate (CFR) metric and INC incidents to the Median Time to Restore (MTTR) metric. They are technically different, and I'm wondering if DevLake would treat them the same. According to the API spec, it seems like CFR and MTTR are based on incidents only and wouldn't take into consideration any type of CHG request for an actual failed deployment.

Is this a correct understanding? Did I miss something?

[dosubot[bot]]

DevLake handles data from webhooks by allowing users to push JSON payloads to a unique URL generated for each Incoming Webhook. This provides flexibility in integrating data from DevOps tools, such as ServiceNow, that do not have a specific plugin available. You can customize the payload schema to include details necessary for DORA metrics, such as deployment information ^[1][2].

Regarding the association of ServiceNow Change Requests (CHG) with the Change Failure Rate (CFR) metric and Incidents (INC) with the Median Time to Restore (MTTR) metric, the current understanding is that DevLake's API specification primarily bases CFR and MTTR on incidents. It does not explicitly mention the inclusion of CHG requests for failed deployments in these metrics ^[1][2]. Therefore, your understanding seems correct based on the available information.

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other}