Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for OTLP metrics export #3816

Open
gfonseca-tc opened this issue Jul 13, 2022 · 4 comments
Open

Support for OTLP metrics export #3816

gfonseca-tc opened this issue Jul 13, 2022 · 4 comments

Comments

@gfonseca-tc
Copy link

Is your feature request related to a problem? Please describe.

Most modern observability tools use to push metrics instead of letting a server pulling them. It's less prone to error since who is generating the metrics can decide when to send metrics. Also, when we have fluentd running in containers, it's even harder to keep track of all instances and collect metrics from all of them. Having them sending metrics to a centralized gateway on the other side is much easier.
On top of that, OpenTelemetry is becoming a standard in the industry and it seems to make sense having support for it in FluentD.

Describe the solution you'd like

Having a way of sending OTLP metrics to a configured OTLP endpoint.

Describe alternatives you've considered

The Prometheus plugin is very versatile and the OpenTelemetry collector has a scraper for prometheus endpoints, making it easy to initially migrate to OTel. But it doesn't solve the problem of having FluentD containerized and collecting metrics from all containers. Enabling FluentD to send those metrics periodically to a gateway seems more reliable to me.

Additional context

No response

@cosmo0920
Copy link
Contributor

In Fluent Bit side, it will be handled by cmetrics library.
If we will support OTEL handling, we have to use and depend on it.

@cosmo0920
Copy link
Contributor

cosmo0920 commented Jul 28, 2022

If we add cmetrics gem as runtime dependency, we can handle OTEL and Prometheus context natively in Fluentd core.

@gfonseca-tc
Copy link
Author

I would love to see this feature in place! Not sure how stable the cmetrics library is, but it seems like a good option.

@cosmo0920
Copy link
Contributor

Or, using otel official Ruby gem would be much better: https://github.com/open-telemetry/opentelemetry-ruby

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants