[beats receivers] OTel manager failed: error creating metricbeatreceiver: error setting up metrics report: failed to init process stats for agent: failed to compile regexp [User.Name��]: error parsing regexp: invalid UTF-8: `��`

[cmacknz]

• Version: 9.2.0 (with agent.monitoring._runtime_experimental: otel)
• Operating System: MacOS(15.7.1)

Relevant part of state.yaml:

fleet_message: Connected
fleet_state: 2
log_level: info
message: 'OTel manager failed: supervised collector (pid: 94473) exited with error: exit status 1'
state: 4
# All components healthy, no other details

Relevant logs (note the actual user name was substituted with User.Name as this is an Elastic employee outside the Elastic Agent team):

{"log.level":"info","@timestamp":"2025-11-13T07:52:52.537Z","log.logger":"otel_manager","log.origin":{"function":"github.com/elastic/elastic-agent/internal/pkg/otel/manager.(*OTelManager).Run","file.name":"manager/manager.go","file.line":226},"message":"collector recovery restarting, total retries: 3","log":{"source":"elastic-agent"},"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T07:52:52.546Z","log.origin":{"function":"github.com/elastic/elastic-agent/internal/pkg/otel/manager.(*subprocessExecution).startCollector","file.name":"manager/execution_subprocess.go","file.line":136},"message":"supervised collector started with pid: 93705 and healthcheck port: 57436","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T07:52:52.586Z","log.logger":"component.runtime.endpoint-default.service_runtime","log.origin":{"function":"github.com/elastic/elastic-agent/pkg/component/runtime.(*serviceRuntime).Run","file.name":"runtime/service.go","file.line":245},"message":"Creating connection info server for endpoint service, address: unix:///Library/Elastic/Agent/.eaci.sock","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T07:52:52.587Z","log.logger":"component.runtime.endpoint-default.service_runtime","log.origin":{"function":"github.com/elastic/elastic-agent/pkg/component/runtime.(*serviceRuntime).start","file.name":"runtime/service.go","file.line":397},"message":"check if endpoint service is installed","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T07:52:52.589Z","message":"Starting in otel mode","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T07:52:52.589Z","message":"Starting stats endpoint","log.logger":"edot.api","log.origin":{"file.line":85,"file.name":"api/server.go","function":"github.com/elastic/elastic-agent-libs/api.(*Server).Start"},"ecs.version":"1.6.0","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T07:52:52.589Z","message":"Metrics endpoint listening on: /Library/Elastic/Agent/data/tmp/jTgjFSdPDnYoazUu541NazzsJSv6daDn.sock (configured: unix:///Library/Elastic/Agent/data/tmp/jTgjFSdPDnYoazUu541NazzsJSv6daDn.sock)","log.logger":"edot.api","log.origin":{"file.line":87,"file.name":"api/server.go","function":"github.com/elastic/elastic-agent-libs/api.(*Server).Start.func1"},"ecs.version":"1.6.0","ecs.version":"1.6.0"}
{"log.level":"warn","@timestamp":"2025-11-13T07:52:52.620Z","message":"telemetry::log_failed_docs_input is enabled, and may expose sensitive data; It should only be used for testing or debugging.","log.origin":{"file.line":521,"file.name":"elasticsearchexporter@v0.137.0/config.go","function":"github.com/open-telemetry/opentelemetry-collector-contrib/exporter/elasticsearchexporter.handleTelemetryConfig"},"resource":{"service.instance.id":"8332cd24-1581-4c8e-84eb-5395d971c110","service.name":"/Library/Elastic/Agent/elastic-agent","service.version":"9.2.0"},"otelcol.component.id":"elasticsearch/_agent-component/monitoring","otelcol.signal":"logs","otelcol.component.kind":"exporter","ecs.version":"1.6.0","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T07:52:52.624Z","message":"Home path: [] Config path: [] Data path: [/Library/Elastic/Agent/data/elastic-agent-9.2.0-e7bf31/run/filestream-monitoring] Logs path: [logs]","resource":{"service.instance.id":"8332cd24-1581-4c8e-84eb-5395d971c110","service.name":"/Library/Elastic/Agent/elastic-agent","service.version":"9.2.0"},"otelcol.component.kind":"receiver","otelcol.signal":"logs","service.name":"filebeat","ecs.version":"1.6.0","otelcol.component.id":"filebeatreceiver/_agent-component/filestream-monitoring","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-monitoring","type":"filestream"},"log":{"source":"filestream-monitoring"},"log.origin":{"file.line":178,"file.name":"instance/beat.go","function":"github.com/elastic/beats/v7/x-pack/libbeat/cmd/instance.NewBeatForReceiver"},"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T07:52:52.624Z","message":"Beat ID: 2481d29a-3935-4e20-a5dc-4f978e94c4e4","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-monitoring","type":"filestream"},"service.name":"filebeat","log.origin":{"file.line":186,"file.name":"instance/beat.go","function":"github.com/elastic/beats/v7/x-pack/libbeat/cmd/instance.NewBeatForReceiver"},"resource":{"service.instance.id":"8332cd24-1581-4c8e-84eb-5395d971c110","service.name":"/Library/Elastic/Agent/elastic-agent","service.version":"9.2.0"},"otelcol.component.id":"filebeatreceiver/_agent-component/filestream-monitoring","otelcol.component.kind":"receiver","otelcol.signal":"logs","log":{"source":"filestream-monitoring"},"ecs.version":"1.6.0","ecs.version":"1.6.0"}
{"log.level":"warn","@timestamp":"2025-11-13T07:52:52.637Z","message":"unable to lookup FQDN: could not get FQDN, all methods failed: failed looking up CNAME: lookup User.Name’s-MacBook-Pro: no such host: failed looking up IP: lookup User.Name’s-MacBook-Pro: no such host, using hostname = User.Name’s-MacBook-Pro as FQDN","otelcol.component.kind":"receiver","service.name":"filebeat","resource":{"service.instance.id":"8332cd24-1581-4c8e-84eb-5395d971c110","service.name":"/Library/Elastic/Agent/elastic-agent","service.version":"9.2.0"},"otelcol.component.id":"filebeatreceiver/_agent-component/filestream-monitoring","otelcol.signal":"logs","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-monitoring","type":"filestream"},"log":{"source":"filestream-monitoring"},"ecs.version":"1.6.0","log.origin":{"file.line":201,"file.name":"instance/beat.go","function":"github.com/elastic/beats/v7/x-pack/libbeat/cmd/instance.NewBeatForReceiver"},"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T07:52:52.639Z","message":"Beat name: User.Name’s-MacBook-Pro","otelcol.signal":"logs","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-monitoring","type":"filestream"},"log":{"source":"filestream-monitoring"},"ecs.version":"1.6.0","log.logger":"publisher","log.origin":{"file.line":105,"file.name":"pipeline/module.go","function":"github.com/elastic/beats/v7/libbeat/publisher/pipeline.LoadWithSettings"},"resource":{"service.instance.id":"8332cd24-1581-4c8e-84eb-5395d971c110","service.name":"/Library/Elastic/Agent/elastic-agent","service.version":"9.2.0"},"service.name":"filebeat","otelcol.component.id":"filebeatreceiver/_agent-component/filestream-monitoring","otelcol.component.kind":"receiver","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2025-11-13T07:52:52.640Z","message":"error found during service initialization","error":{"message":"failed to build pipelines: failed to create \"filebeatreceiver/_agent-component/filestream-monitoring\" receiver for data type \"logs\": error creating filebeatreceiver:error setting up metrics report: failed to init process stats for agent: failed to compile regexp [User.Name��]: error parsing regexp: invalid UTF-8: `��`"},"ecs.version":"1.6.0","log.origin.stack_trace":"go.opentelemetry.io/collector/service.New.func1\n\tgo.opentelemetry.io/collector/service@v0.137.0/service.go:140\ngo.opentelemetry.io/collector/service.New\n\tgo.opentelemetry.io/collector/service@v0.137.0/service.go:200\ngo.opentelemetry.io/collector/otelcol.(*Collector).setupConfigurationComponents\n\tgo.opentelemetry.io/collector/otelcol@v0.137.0/collector.go:195\ngo.opentelemetry.io/collector/otelcol.(*Collector).Run\n\tgo.opentelemetry.io/collector/otelcol@v0.137.0/collector.go:310\ngithub.com/elastic/elastic-agent/internal/pkg/otel.Run\n\tgithub.com/elastic/elastic-agent/internal/pkg/otel/run.go:41\ngithub.com/elastic/elastic-agent/internal/pkg/agent/cmd.RunCollector\n\tgithub.com/elastic/elastic-agent/internal/pkg/agent/cmd/otel.go:124\ngithub.com/elastic/elastic-agent/internal/pkg/agent/cmd.newOtelCommandWithArgs.func1\n\tgithub.com/elastic/elastic-agent/internal/pkg/agent/cmd/otel.go:58\ngithub.com/spf13/cobra.(*Command).execute\n\tgithub.com/spf13/cobra@v1.10.1/command.go:1015\ngithub.com/spf13/cobra.(*Command).ExecuteC\n\tgithub.com/spf13/cobra@v1.10.1/command.go:1148\ngithub.com/spf13/cobra.(*Command).Execute\n\tgithub.com/spf13/cobra@v1.10.1/command.go:1071\nmain.main\n\tgithub.com/elastic/elastic-agent/main.go:32\nruntime.main\n\truntime/proc.go:283","log.origin":{"file.line":140,"file.name":"service@v0.137.0/service.go","function":"go.opentelemetry.io/collector/service.New.func1"},"resource":{"service.instance.id":"8332cd24-1581-4c8e-84eb-5395d971c110","service.name":"/Library/Elastic/Agent/elastic-agent","service.version":"9.2.0"},"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T07:52:52.640Z","message":"Stats endpoint (/Library/Elastic/Agent/data/tmp/jTgjFSdPDnYoazUu541NazzsJSv6daDn.sock) finished: accept unix /Library/Elastic/Agent/data/tmp/jTgjFSdPDnYoazUu541NazzsJSv6daDn.sock: use of closed network connection","ecs.version":"1.6.0","log.logger":"edot.api","log.origin":{"file.line":90,"file.name":"api/server.go","function":"github.com/elastic/elastic-agent-libs/api.(*Server).Start.func1"},"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T07:52:52.640Z","message":"failed to build pipelines: failed to create \"filebeatreceiver/_agent-component/filestream-monitoring\" receiver for data type \"logs\": error creating filebeatreceiver:error setting up metrics report: failed to init process stats for agent: failed to compile regexp [User.Name\ufffd\ufffd]: error parsing regexp: invalid UTF-8: `\ufffd\ufffd`","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2025-11-13T07:52:52.643Z","log.logger":"otel_manager","log.origin":{"function":"github.com/elastic/elastic-agent/internal/pkg/otel/manager.(*OTelManager).Run","file.name":"manager/manager.go","file.line":299},"message":"collector exited with error (will try to recover in 476ns): supervised collector (pid: 93705) exited with error: exit status 1","log":{"source":"elastic-agent"},"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T07:52:52.643Z","log.logger":"otel_manager","log.origin":{"function":"github.com/elastic/elastic-agent/internal/pkg/otel/manager.(*OTelManager).Run","file.name":"manager/manager.go","file.line":226},"message":"collector recovery restarting, total retries: 4","log":{"source":"elastic-agent"},"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T07:52:52.651Z","log.origin":{"function":"github.com/elastic/elastic-agent/internal/pkg/otel/manager.(*subprocessExecution).startCollector","file.name":"manager/execution_subprocess.go","file.line":136},"message":"supervised collector started with pid: 93707 and healthcheck port: 57453","ecs.version":"1.6.0"}

[elasticmachine]

Pinging @elastic/elastic-agent-control-plane (Team:Elastic-Agent-Control-Plane)

[mauri870]

I think I found the culprint. When we set up metrics for receivers, we use b.Info.Name to call SetupMetricOptions
https://github.com/elastic/beats/blob/32b5e5a/x-pack/libbeat/cmd/instance/receiver.go#L55. This field contains the hostname of the machine.

Then SetupMetricsOptions tries to get a process name from this field
https://github.com/elastic/elastic-agent-system-metrics/blob/4099ce9/report/setup.go#L64-L66

This process_name function is not UTF-8 aware, so it just fetches the first 15 bytes from the string. If there is part of a multibyte rune at that index, then the resulting string includes corrupted utf8.
https://github.com/elastic/elastic-agent-system-metrics/blob/4099ce9/report/setup.go#L91-L96