Skip to content

Data from one pipeline is being exported to another pipeline #13270

Open
@younusmohmmad

Description

@younusmohmmad

Component(s)

Opentelemetry Collector

What happened?

Describe the bug
I have this setup in my opentelemetry collector

pipelines:
   logs/abc:
      receivers: [ tcplog, filelog]
      processors: [ transform/abc, batch]
      exporter: [ otlphttp/abc]
   logs/def:
       receivers: [tcplog, filelog]
       processors: [ transform/abc, transform/def , batch]
       exporters: [otlphttp/def]

Now in a very irregular fashion, some logs from logs/def pipeline which are already processed through transform/abc -> transform/def -> batch are exported to otlphttp/abc backend which is not configured in logs/def

This happens very intermittently and I was not able to dig much into it.

I am still trying to find the root cause.
But I wanted to ask is it a valid pipeline configuration, having two same receivers and a same starting processor?
Is there any alternate way to achieve this kind of data flow?

Steps to reproduce
Include same receivers and same first processor in two different pipelines with two different backends.

What did you expect to see?
Data should get exported to the respective backend instead of overlapping or misbehaving

What did you see instead?
Data from one pipeline going into another exporter

Collector version

0.127.0

Environment information

Environment

OS: (e.g., "Ubuntu 20.04")
Compiler(if manually compiled): (e.g., "go 14.2")

OpenTelemetry Collector configuration

Log output

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions