Skip to content

multiple log format support #12

@karthiknagraj

Description

@karthiknagraj

Hi,
I have containers that emit logs in containerd format, Which is

2022-12-21T16:39:12.398315079Z stdout F 10.1.92.199 - - [21/Dec/2022:16:39:12 +0000] "GET / HTTP/1.1" 200 8430 "-" "kube-probe/1.24+" "-"

also, I have a few containers which emit logs in JSON format

2023-01-03T10:51:18.181368202Z stderr F  {"event":{"severity":"Critical","version":"1.0","eventName":"availability state","eventStatus":"UP"}}

Below is my current configuration:

<source>
  @type tail
  @id in_tail_container_logs
  path /var/log/containers/*.log
  exclude_path ["/var/log/containers/fluentd*.log"]
  pos_file /var/log/{{.ID}}-fluentd-containers.log.pos
  pos_file_compaction_interval 72h
  tag kubernetes.*
  read_from_head true
  follow_inodes true
  <parse>
    @type cri
    merge_cri_fields true
    time_format %Y-%m-%dT%H:%M:%S.%NZ
  </parse>
</source>

With the above Config, I am only getting logs that are in text format. How can I get logs of both text and JSON formats. Please let me know how I can achieve this goal. Thanks

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions