Skip to content

[kafka] Instrumentation floods debug logs #4216

Open
@lachmatt

Description

@lachmatt

Bug Report

Symptom

v1.11.0 modified the instrumentation for messaging instrumentations, specifically Confluent.Kafka client.
Previously, activity was started after receive completed, if there was a message received.
Now, activity is started when receive starts, and discarded when receive ends, when no message was received.
This frequent starting and discarding of activities, especially when Consume with CancellationToken is used (which polls every 100ms by default), results in a lot of noise in our instrumentation logs, when OTEL_LOG_LEVEL is configured with a value of debug (which is documented to be used only during troubleshooting).

Setting OTEL_LOG_LEVEL to debug results in our event listener subscribing to Verbose events from SDK event source.
Activity listener configured by SDK produces Verbose event any time activity is started or stopped.

When default sink type (i.e File) is used, size of log files is bounded.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions