Export comet metrics externally through spark's monitoring system #3712
Description
What is the problem the feature request solves?
We currently collect metrics and show while logging in comet. This PR is to essentially go a step further and wire the metrics out to be visualized in comet through tools like Grafana . As more users start using comet, these metrics would be helpful in understanding acceleration from comet standpoint
Describe the potential solution
No response
Additional context
No response