Generate "business" statistics (in logs)

[szpak]

How are you running Renovate?

Self-hosted

If you're self-hosting Renovate, tell us what version of Renovate you run.

35.40.0

If you're self-hosting Renovate, select which platform you are using.

GitLab self-hosted

Was this something which used to work for you, and then stopped?

I never saw this working

Wanted end result.

Introducing Renovate in an organization, I started with a few testing project, added some more (still defined explicitly) and, in the end, I am using an autodiscovery feature, just adding the Renovate user to another groups in GitLab. It works pretty well, however, I am also a person who like to see a progress of own actions.

It could be useful to have Renovate(-cli) to produce some "business" stats expressing "metrics" such as number of: processed projects (in general, in onboarding, effectively active), ignored projects, new generated MRs, updated MRs, avg/max execution time per project, ...

They could be gathered (somehow) from logs and collected (in external way - not in the scope if this feature idea) to be able to generate some incremental analysis (e.g. charts in Grafana).

What you tried so far.

I have seen that Renovate supports exporting traces in OTel format (which is great!), however, I'm not sure, if it would be possible to obtain the "metrics", I mentioned (rather to trace where processing takes the most). Exposing the metrics endpoint (mend/renovate-ce-ee#221) could be useful for the on-prem version (to some degree), but it is somehow problematic if the cli is used from a CI server.

Currently, I gather some stats by parsing logs with jq (e.g. top X repos by processing time or number of requests), but it requires an extra effort (and jq stills :) ) to parse JSON logs (and some of the aforementioned metrics could be harder to get). Having renovate logging them in one JSON info entry would make it much easier to get and process. WDYT?

Relevant debug logs

No response

[secustor]

Your are probably interested in #17661
and https://docs.renovatebot.com/examples/opentelemetry/

[HonkingGoose]

And some metrics we've added after the article and thus aren't in the screenshot: the number of create/update/merge/delete over time, totals, and graphed values. Very useful to see hot spots of activity

By the way, @onigoetz do you want to open a PR to update the screenshot? It would be nice for me, and the Renovate docs readers to see your improved dashboard.

Link to the .png file for the Swissquote dashboard.

[HonkingGoose]

@rarkins said:

I think it would be good to have a simple log at the end of each repo which captures:

* per run metrics (e.g. commits and PRs created/updated/merged/deleted/etc)

* per repo metrics (PRs open, awaiting, merged, etc.)

Issue #17661 asks for Prometheus Metrics for Observability. That issue is still in status:requirements.

I suspect putting some metrics in a console log statement is easier than the Prometheus Metrics. 😄 I can't find any issue for "simple log at end of repo run". So, @rarkins do you want me to create a new "simple logging" issue for us?

[rarkins]

Yes please

[HonkingGoose]

Here's your issue! 😉

• Put repo and run metrics in log messages #23961

[HonkingGoose]

By the way, @onigoetz do you want to open a PR to add your diagram and explanations into the Renovate swissquote article? Also, the metrics under the new dashboard image don't match the image anymore.

• Generate "business" statistics (in logs) #23105 (reply in thread)
• Swissquote article source file

[onigoetz]

Hi @HonkingGoose yeah sure, I could.

I just wasn't sure if you would be big fans of this since it diverges from your own offering, but sure, I can make a PR to add it

[HonkingGoose]

Thanks for the quick response! ❤️ I'm a fan of adding the extra information to our docs. So I'm happy to accept a PR that adds the diagram and extra information, and the updated metrics.

[HonkingGoose]

@MShekow built a custom Renovate dashboard. Here's their comment from another discussion: ¹

By the way, I built a prototype for visualizing Renovate PRs, feel free to check it out: https://github.com/MShekow/renovate-pr-visualization

Footnotes

1. https://github.com/renovatebot/renovate/discussions/26024#discussioncomment-7897831 ↩