[BUG] OTLP ingest fails on initialisation when providing DD_OTLP_CONFIG_RECEIVER_PROTOCOLS_GRPC_MAX_RECV_MSG_SIZE_MIB

[KiraShatskyi]

When specifying DD_OTLP_CONFIG_RECEIVER_PROTOCOLS_GRPC_MAX_RECV_MSG_SIZE_MIB environment variable, the OTLP ingest fails and does not start.

The logs suggest a straightforward issue of failed string to int conversion:

February 12, 2025 at 12:06 (UTC+1:00) | 2025-02-12 11:06:14 UTC \| CORE \| ERROR \| (comp/otelcol/collector/impl-pipeline/pipeline.go:112 in func1) \| Error running the OTLP ingest pipeline: failed to get config: cannot unmarshal the configuration: decoding failed due to the following error(s): | datadog-agent
-- | -- | --
February 12, 2025 at 12:06 (UTC+1:00) | error decoding 'receivers': error reading configuration for "otlp": decoding failed due to the following error(s): | datadog-agent
February 12, 2025 at 12:06 (UTC+1:00) | error decoding '': decoding failed due to the following error(s): | datadog-agent
February 12, 2025 at 12:06 (UTC+1:00) | 'protocols.grpc.max_recv_msg_size_mib' expected type 'int', got unconvertible type 'string', value: '16'

Agent Environment
Agent version: 7.62.2
Relevant environment variables supplied to the agent:

DD_OTLP_ENABLED=true
DD_OTLP_CONFIG_RECEIVER_PROTOCOLS_GRPC_ENDPOINT=0.0.0.0:4317
DD_OTLP_CONFIG_RECEIVER_PROTOCOLS_HTTP_ENDPOINT=0.0.0.0:4318
DD_OTLP_CONFIG_RECEIVER_PROTOCOLS_GRPC_MAX_RECV_MSG_SIZE_MIB=16

Describe what happened:
OTLP ingest pipeline errors on init because of failed decoding of ENV variable.

Describe what you expected:
Agent working as expected without error.

Steps to reproduce the issue:

1. Start the DD agent with the provided environment variables in Agent Environment section.
2. Observe in logs the error of Error running the OTLP ingest as shows before.
3. Observe that ingest pipeline did not start (pushing anything to that port fails).

Additional environment details (Operating System, Cloud provider, etc):
OS: Linux/X86_64
Cloud Provider: AWS ECS Fargate

[liustanley]

Thanks for reporting this, I was able to reproduce the issue and opened an internal ticket to investigate and fix this behavior.

[dd-octo-sts]

This issue has been automatically marked as stale because it has not had activity in the past 15 days.

It will be closed in 30 days if no further activity occurs. If this issue is still relevant, adding a comment will keep it open. Also, you can always reopen the issue if you missed the window.

Thank you for your contributions!

[rdesgroppes]

@KiraShatskyi, this should now be fixed. I'll trigger a backport for upcoming 7.73 release.