Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

metrics support #715

Merged
merged 2 commits into from
Sep 18, 2020
Merged

metrics support #715

merged 2 commits into from
Sep 18, 2020

Conversation

pohly
Copy link
Contributor

@pohly pohly commented Aug 26, 2020

The Prometheus integration uses the approach from
helm/charts#22899:
- HTTP for metrics endpoints
- container ports tell Prometheus which containers to scrape
and how

CSI call counts are the same as in the sidecars. This enables
correlating statistics and ensures that also node-local operations are
captured; kubelet doesn't seem to be instrumented.

Internal communication is instrumented the same way.

PMEM usage statistics are recording by querying the device manager
each time the metrics data gets scraped.

The metrics support is enabled unconditionally in the operator and all
pre-generated deployment files and use plain HTTP for the sake of
simplicity. This is based on the rationale that the data itself is
not sensitive and should always be readily available if desired.

TODO:

@pohly
Copy link
Contributor Author

pohly commented Aug 26, 2020

Force-pushed to trigger CI testing.

@pohly pohly force-pushed the metrics-enhancements branch 2 times, most recently from bc7a4e5 to f545758 Compare August 27, 2020 06:23
@pohly pohly requested a review from avalluri August 27, 2020 06:41
Those date back to the very beginning of the project and were used as
a reminder for content that might be missing. We have added everything
over time, so they no longer serve any real purpose.
@pohly pohly force-pushed the metrics-enhancements branch 2 times, most recently from 8c34c9f to 8cf3d52 Compare September 11, 2020 13:45
@pohly pohly changed the title WIP: metrics support metrics support Sep 11, 2020
@pohly
Copy link
Contributor Author

pohly commented Sep 11, 2020

@avalluri this PR is ready, I finished all pending TODOs.

docs/install.md Outdated
<!-- FILL TEMPLATE:
### Metrics support

:bangbang: | Metric support is an alpha feature. What data is provided may change.
Copy link
Contributor Author

@pohly pohly Sep 16, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This works on GitHub (not surpising, I got this from github/markup#887) but not in Sphinx (just shows :bangbang:):

https://cloudnative-k8sci.southcentralus.cloudapp.azure.com/job/pmem-csi/job/PR-715/Doc_20Site/docs/install.html#metrics-support

@intelkevinputnam : do you have a suggestion how we can mark up warnings in our documentation?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'll merge without this warning and instead moved it into an issue: #736

Copy link
Contributor

@avalluri avalluri left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good.

The Prometheus integration uses the approach from
helm/charts#22899:
- HTTP for metrics endpoints
- container ports tell Prometheus which containers to scrape
  and how

CSI call counts are the same as in the sidecars. This enables
correlating statistics and ensures that also node-local operations are
captured; kubelet doesn't seem to be instrumented.

Internal communication is instrumented the same way.

PMEM usage statistics are recorded by querying the active device
manager each time the metrics data gets scraped.

The metrics support is enabled unconditionally in the operator and all
pre-generated deployment files and use plain HTTP for the sake of
simplicity. This is based on the rationale that the data itself is
not sensitive and should always be readily available if desired.
@pohly pohly mentioned this pull request Sep 18, 2020
@pohly pohly merged commit bd0feaa into intel:devel Sep 18, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants