Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Storage metrics don't reflect I/O from all devices #38301

Open
jonnangle opened this issue Mar 3, 2025 · 1 comment · May be fixed by #38309
Open

Storage metrics don't reflect I/O from all devices #38301

jonnangle opened this issue Mar 3, 2025 · 1 comment · May be fixed by #38309
Assignees
Labels

Comments

@jonnangle
Copy link
Contributor

Component(s)

receiver/awsecscontainermetrics

What happened?

Description

storage.read_bytes and storage.write_bytes metrics only reflect one block device.

Steps to Reproduce

Create an ECS task with a container that uses multiple block IO devices.

Expected Result

The metrics reflect the sum of all Read / Write op counters exposed via blkio_stats.io_service_bytes_recursive.

Actual Result

The metrics only reflect the metric from the final Read/Write op counter in the list.

Collector version

v0.120.0

Environment information

Environment

OS: Linux on AWS ECS Fargate

OpenTelemetry Collector configuration

receivers:
  awsecscontainermetrics:
    collection_interval: 60s

processors:
  batch:
    timeout: 200ms

exporters:
  prometheusremotewrite:
    endpoint: https://prometheus.endpoint

service:
  pipelines:
    metrics:
      receivers:
        - awsecscontainermetrics
      processors:
        - batch
      exporters:
        - prometheusremotewrite

Log output

Additional context

Fix for this: accumalate reads/writes when iterating over the IoServiceBytesRecursives list here.

@jonnangle jonnangle added bug Something isn't working needs triage New item requiring triage labels Mar 3, 2025
Copy link
Contributor

github-actions bot commented Mar 3, 2025

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
2 participants