-
Notifications
You must be signed in to change notification settings - Fork 26
HTTP REST Api endpoint http_metrics
-
/http_metrics
-
Supported for both: OpenTSDB API and Prometheus API
-
Provides detailed performance metrics for HTTP requests processed by the grafana-bridge. This endpoint exposes execution time statistics that help administrators:
Monitor overall performance: Track total HTTP request execution time to identify performance degradation Analyze backend wait times: Measure time spent waiting for backend responses to pinpoint bottlenecks Identify slow queries: Detect which requests are taking longer than expected Optimize resource allocation: Make informed decisions about scaling and resource distribution based on actual performance data Troubleshoot issues: Quickly diagnose performance problems by correlating metrics with specific bundle_ids
-
The endpoint returns metrics in a format compatible with monitoring tools and can be integrated with the provided example dashboards for real-time performance observability.
-
Prerequisites: To enable this endpoint, set
http_metrics_enabled = Truein the configuration file.
-
Example output:
```console
# curl http://10.88.3.241:4242/http_metrics?format=csv -u scale_admin:TXlWZXJ5U3Ryb25nUGFzc3cwcmQhCg==
timestamp,metric_name,bundle_id,collector_name,gpfs_fs_name,node,value
2026-05-29 15:55:26,perfmon_response_duration,688bda182a9a2fb7,GPFSNSDDisk,,,0.046193
2026-05-29 15:55:26,perfmon_response_amount,688bda182a9a2fb7,GPFSNSDDisk,,,217409
2026-05-29 15:55:26,PrometheusExporter_metrics,688bda182a9a2fb7,GPFSNSDDisk,,,0.09235337298014201
2026-05-29 15:55:26,perfmon_response_duration,528b7112434a4be3,gpfs_fs_bytes_written,remoteFS,.*,0.017609
2026-05-29 15:55:26,perfmon_response_amount,528b7112434a4be3,gpfs_fs_bytes_written,remoteFS,.*,53830
2026-05-29 15:55:26,OpenTsdbApi_query,528b7112434a4be3,gpfs_fs_bytes_written,,,0.02721130699501373
2026-05-29 15:55:36,perfmon_response_duration,688bda182a9a2fb7,GPFSNSDDisk,,,0.06234
2026-05-29 15:55:36,perfmon_response_amount,688bda182a9a2fb7,GPFSNSDDisk,,,217409
```
Example output:
```console
# curl http://10.88.3.241:9250/http_metrics -u scale_admin:TXlWZXJ5U3Ryb25nUGFzc3cwcmQhCg==
# HELP perfmon_response_duration time in seconds how long perfmon took to complete response_duration
# TYPE perfmon_response_duration gauge
perfmon_response_duration{bundle_id="688bda182a9a2fb7",collector_name="GPFSNSDDisk"} 0.076094 1780066376000
perfmon_response_duration{bundle_id="6513d5a7bcac7726",collector_name="GPFSFilesystem"} 0.042114 1780066385000
perfmon_response_duration{bundle_id="7f8d7f8ffaf43581",collector_name="GPFSTSCOM"} 0.117388 1780066386000
perfmon_response_duration{bundle_id="688bda182a9a2fb7",collector_name="GPFSNSDDisk"} 0.058979 1780066386000
perfmon_response_duration{bundle_id="688bda182a9a2fb7",collector_name="GPFSNSDDisk"} 0.071591 1780066396000
perfmon_response_duration{bundle_id="688bda182a9a2fb7",collector_name="GPFSNSDDisk"} 0.056469 1780066406000
perfmon_response_duration{bundle_id="688bda182a9a2fb7",collector_name="GPFSNSDDisk"} 0.06822 1780066416000
perfmon_response_duration{bundle_id="688bda182a9a2fb7",collector_name="GPFSNSDDisk"} 0.06785 1780066426000
perfmon_response_duration{bundle_id="688bda182a9a2fb7",collector_name="GPFSNSDDisk"} 0.065187 1780066436000
perfmon_response_duration{bundle_id="7f8d7f8ffaf43581",collector_name="GPFSTSCOM"} 0.139249 1780066446000
# HELP perfmon_response_amount bytes received by perfmon though response_amount completion
# HELP perfmon_response_amount bytes received by perfmon though response_amount completion
# TYPE perfmon_response_amount gauge
perfmon_response_amount{bundle_id="688bda182a9a2fb7",collector_name="GPFSNSDDisk"} 217409 1780066376000
perfmon_response_amount{bundle_id="6513d5a7bcac7726",collector_name="GPFSFilesystem"} 105895 1780066385000
perfmon_response_amount{bundle_id="7f8d7f8ffaf43581",collector_name="GPFSTSCOM"} 1469330 1780066386000
perfmon_response_amount{bundle_id="688bda182a9a2fb7",collector_name="GPFSNSDDisk"} 217409 1780066386000
perfmon_response_amount{bundle_id="688bda182a9a2fb7",collector_name="GPFSNSDDisk"} 217409 1780066396000
perfmon_response_amount{bundle_id="688bda182a9a2fb7",collector_name="GPFSNSDDisk"} 217409 1780066406000
perfmon_response_amount{bundle_id="688bda182a9a2fb7",collector_name="GPFSNSDDisk"} 217409 1780066416000
perfmon_response_amount{bundle_id="688bda182a9a2fb7",collector_name="GPFSNSDDisk"} 217409 1780066426000
perfmon_response_amount{bundle_id="688bda182a9a2fb7",collector_name="GPFSNSDDisk"} 217409 1780066436000
perfmon_response_amount{bundle_id="7f8d7f8ffaf43581",collector_name="GPFSTSCOM"} 1469261 1780066446000
# HELP PrometheusExporter_metrics time in seconds how long PrometheusExporter took to complete metrics
# TYPE PrometheusExporter_metrics gauge
PrometheusExporter_metrics{bundle_id="688bda182a9a2fb7",collector_name="GPFSNSDDisk"} 0.1277058230189141 1780066376000
PrometheusExporter_metrics{bundle_id="6513d5a7bcac7726",collector_name="GPFSFilesystem"} 0.06066851498326287 1780066385000
PrometheusExporter_metrics{bundle_id="7f8d7f8ffaf43581",collector_name="GPFSTSCOM"} 0.473276659991825 1780066386000
PrometheusExporter_metrics{bundle_id="688bda182a9a2fb7",collector_name="GPFSNSDDisk"} 0.11330086502130143 1780066386000
PrometheusExporter_metrics{bundle_id="688bda182a9a2fb7",collector_name="GPFSNSDDisk"} 0.12639228499028832 1780066396000
PrometheusExporter_metrics{bundle_id="688bda182a9a2fb7",collector_name="GPFSNSDDisk"} 0.10785587600548752 1780066406000
PrometheusExporter_metrics{bundle_id="688bda182a9a2fb7",collector_name="GPFSNSDDisk"} 0.12581113798660226 1780066416000
PrometheusExporter_metrics{bundle_id="688bda182a9a2fb7",collector_name="GPFSNSDDisk"} 0.11956242797896266 1780066426000
PrometheusExporter_metrics{bundle_id="688bda182a9a2fb7",collector_name="GPFSNSDDisk"} 0.11821636199601926 1780066436000
PrometheusExporter_metrics{bundle_id="7f8d7f8ffaf43581",collector_name="GPFSTSCOM"} 0.4647844419814646 1780066446000
```
Visit the IBM Storage Scale Knowledge Center for getting more info about the latest product updates
-
- Setup classic Grafana
- Make usage of Grafana Provisioning feature
-
- Installing RedHat community-powered Grafana operator from OperatorHub
- Creating Grafana instance using the RedHat community-powered Grafana-operator
- Creating Grafana Datasorce instance from Custom Resource managed by the RedHat community powered Grafana operator
- Importing the predefined dashboard from the example dashboards collection
- Exploring Grafana WEB interface for CNSA project in a k8s OCP environment
- How to setup Grafana instance to monitor multiple IBM Storage Scale clusters running in a cloud or mixed environment
- API key authentication
- Configurable bridge settings
- CherryPy builtin HTTP server settings
- How to setup HTTPS(SSL) connection
- Start and stop grafana-bridge with systemd
- Refresh IBM Storage Scale cluster configuration data cached by grafana bridge
- Accelerate the PrometheusExporter data retrieval time
- Optimize the performance of PrometheusExporter by using scrape_job params settings
- Grafana Dashboard Panel shows no metric values for a particular entity
- Missing Grafana-Operator on an OpenShift cluster
- Missing CherryPy packages
- What to do if your system is on Python < 3.8
- Grafana-bridge fails to start with Python3.8
- Grafana-bridge container time is different from a host time
- Grafana-bridge container does not return metrics for sensors restricted to a subset of nodes
- Verify that the grafana-bridge returns data as expected
- Grafana-bridge HTTP REST Api interface
- How to monitor performance of the IBM Storage Scale bridge for Grafana