-
Notifications
You must be signed in to change notification settings - Fork 22
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Provide metrics to measure the amount and measure the type of work done by JBI #173
Comments
Since v3.1.0 we have these metrics:
Most of the measurements you describe should be doable with Grafana (we don't count failed calls, but since a Sentry is sent each time, we expect them to be 0). In case Grafana is not adequate, I think that the application logs are also sent to BigQuery. So in theory, with the appropriate permissions, we could also have a Redash sheet that queries logs to count operations (we log them consistently) |
What I would like to do is be able to get a sum of the change operations JBI has done over a specific time. In pseudo SQL:
To produce a table like:
It'll be a query I run monthly/quarterly. Is this something that I can easily accomplish with the statsd metrics? I think the data in BQ would be easier to run a query like that. Though, I'm not sure if the data I need is in BQ or which log fields I would need to look at. |
The following query should provide something similar. SELECT
extract(YEAR FROM timestamp) AS year,
extract(MONTH FROM timestamp) AS month,
jsonPayload.fields.operation AS operation,
COUNT(*) AS total
FROM `moz-fx-jbi-prod-0397.log_storage.stdout_*`
WHERE
resource.labels.container_name = 'jbi' AND
jsonPayload.Logger = 'jbi' AND
jsonPayload.fields.operation IS NOT NULL
GROUP BY 1, 2, 3
ORDER BY 1, 2, 4 DESC For some reason, I don't see (yet?) the operations we introduced in v3.2.X ( @mostlygeek Do you really need detail at the "method" level? Or, the enum that is here would be enough? jira-bugzilla-integration/jbi/__init__.py Lines 10 to 22 in fcb7390
|
That's perfect! Thank you! |
Follow up:
In #157 the |
I'm interesting in being able to measure how much work manual JBI is automating away for us.
I believe the numbers I need for this are:
Questions:
The text was updated successfully, but these errors were encountered: