Add option for CLI to leave a comment in pull requests

[kwonoj]

Curious if it's possible to cli create a PR comment similar to code coverage, that shows diff for the changed metrics and some graphs per configuration if possible. It'd be helpful to track changes without switching context from gh PR page.

[fwuensche]

That's a real demand. I guess it is totally doable if we have access to the right credentials.

I'd start by leaving a text-only comment with the current diff, and then expand from there (if necessary).

As for the implementation, I think it makes sense to associate it with the execution of the cherry diff command, which is where we already have the required info. But I'm not sure about the API.

Would it be an option provided to the cherry diff command? Would it be something defined in the configuration file? Maybe via a plugin? What do you have in mind?

[kwonoj]

I really haven't thought about the logistics of the feature, just came to think it'd be great to have one. For the workflow perspective, regardless of how it is being triggered I hope it takes care of most of heavylifting, i.e detect the context if it's legit to create comment (===PR), creates a correct text payload, create / or update comment if previous run had comment, etcs. It is not impossible to create those behaviors manually but that's quite cumbersome to do so.