Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

processor_opentelemetry_envelope: new processor to package non OTel Logs content as OTel #9001

Merged
merged 4 commits into from
Jun 24, 2024
Merged

processor_opentelemetry_envelope: new processor to package non OTel Logs content as OTel #9001

merged 4 commits into from
Jun 24, 2024

Commits on Jun 24, 2024

  1. out_opentelemetry: release log resource if attributes are empty 

    Signed-off-by: Eduardo Silva <eduardo@calyptia.com>
    @edsiper
    edsiper committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    f65ee7f View commit details
    Browse the repository at this point in the history

  2. mp: allow empty maps when encoding from flb_mp_chunk_cobj 

    Signed-off-by: Eduardo Silva <eduardo@calyptia.com>
    @edsiper
    edsiper committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    3722cc1 View commit details
    Browse the repository at this point in the history

  3. pack: allow printing signed values for timestamp 

    Signed-off-by: Eduardo Silva <eduardo@calyptia.com>
    @edsiper
    edsiper committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    f57aa3e View commit details
    Browse the repository at this point in the history

  4. processor_opentelemetry_envelope: new processor to package non OTel s… 

    …ource as OTel

When collecting data from all plugins except in_opentelemetry, the records comes with
basic timestamp, metadata and content; there are cases where this information collected
needs to send to an OpenTelemetry endpoint (vendor or another OTel compatible endpoint)
and packaging with proper OTel Log Resources and Scopes simplify the data transformation.

This processor creates the internal group with OTel basic structure. Note that this creates
the envelope, for further processing can be used in conjunction with content modifier processor.

usage example:

    pipeline:
      inputs:
        - name: dummy
          samples: 1

          processors:
            logs:
              - name: opentelemetry_envelope

              - name: content_modifier
                context: otel_resource_attributes
                action: upsert
                key: "aaa"
                value: "bbb"

      outputs:
        - name : stdout
          match: '*'

        - name: opentelemetry
          match: '*'
          host: 127.0.0.1
          port: 4318
          logs_uri: /v1/logs

Signed-off-by: Eduardo Silva <eduardo@calyptia.com>
    @edsiper
    edsiper committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    709b28f View commit details
    Browse the repository at this point in the history