Make the fluentd conf configurable from configMap #174

vidhy · 2018-07-12T15:17:57Z

We can have the config files retrieved from configMap ,Instead of baking the fluentd conf files inside the docker image. This would eneble user to give custom configurations.

vpistis · 2018-07-16T13:52:06Z

In my fluentd version 1.2.2 installation I replace config files using a config map mounted into the fluent config path like so:

volumeMounts:
  - name: config-volume
    mountPath: /fluentd/etc

and for the volume:

volumes:
  - name: config-volume
    configMap:
      name: fluentd-config

*I have added the fluentd version

tuchodi · 2018-07-26T12:53:48Z

@vpistis

I replace config files

will fail in k8s, because of:

configMap is RO
CVE-2017-1002102 - atomic writer volume handling allows arbitrary file deletion in host filesystem kubernetes/kubernetes#60814
configMap and secrets volumeMount are always mounted readOnly in 1.9.6 kubernetes/kubernetes#62099 (comment)

Fix impact:
Secret, configMap, downwardAPI and projected volumes will be mounted as read-only volumes. Applications that attempt to write to these volumes will receive read-only filesystem errors.

attempt to sed here https://github.com/fluent/fluentd-kubernetes-daemonset/blob/master/docker-image/v0.12/alpine-elasticsearch/entrypoint.sh#L6-L12

if [ -z ${FLUENT_ELASTICSEARCH_USER} ] ; then
   sed -i  '/FLUENT_ELASTICSEARCH_USER/d' /fluentd/etc/${FLUENTD_CONF}
fi

if [ -z ${FLUENT_ELASTICSEARCH_PASSWORD} ] ; then
   sed -i  '/FLUENT_ELASTICSEARCH_PASSWORD/d' /fluentd/etc/${FLUENTD_CONF}
fi

will crash with error:

sed: can't create temp file '/fluentd/etc/fluent.confXXXXXX': Read-only file system

the issue is still open for k8s

vpistis · 2018-07-30T10:13:59Z

@tuchodi I'm sorry, but I'm not specified that I used the configMap for fluentd 1.2.2 version, and I don't see the RO error.

tuchodi · 2018-07-30T10:29:41Z

@vpistis
configMap clearly specified here #174 (comment):

and for the volume:

volumes:
 - name: config-volume
   configMap:
     name: fluentd-config

it will fail unless you are providing FLUENT_ELASTICSEARCH_USER and FLUENT_ELASTICSEARCH_PASSWORD in env

vpistis · 2018-07-30T11:25:17Z

@tuchodi

it will fail unless you are providing FLUENT_ELASTICSEARCH_USER and FLUENT_ELASTICSEARCH_PASSWORD in env

correct!

...and last but not least, I use fluentd with MongoDB and not Elasticsearch 😎 .
Using the configMap for me solve the problem, I think is not the final solution, but it works ☺️

repeatedly · 2018-08-02T16:46:57Z

Hmm... Does anyone know what is the best way to apply configMap with elasticsearch image?

itayariel · 2018-09-03T12:29:19Z

I used a config map with init container that copies the config files from a config map to an empty dir volume, this way it doesn't fail with the write permissions error

  template:
    metadata:
      labels:
        k8s-app: fluentd-logging
        version: v1
        kubernetes.io/cluster-service: "true"
    spec:
      tolerations:
      - key: node-role.kubernetes.io/master
        effect: NoSchedule
      initContainers:
      - name: config-fluentd
        image: busybox
        imagePullPolicy: IfNotPresent
        command: ["/bin/sh","-c"]
        args:
        - cp /fluentd/etc2/fluent.conf /fluentd/etc/fluent.conf;
          cp /fluentd/etc2/kubernetes.conf /fluentd/etc/kubernetes.conf;
        volumeMounts:
        - name: config-path
          mountPath: /fluentd/etc
        - name: config-source
          mountPath: /fluentd/etc2
      containers:
      - name: fluentd
        image: fluent/fluentd-kubernetes-daemonset:elasticsearch
        env:
          - name:  FLUENT_ELASTICSEARCH_HOST
            value: elasticsearch.default.svc
          - name:  FLUENT_ELASTICSEARCH_PORT
            value: "9200"
          - name: FLUENT_ELASTICSEARCH_SCHEME
            value: "http"
          - name: FLUENT_UID
            value: "0"
          - name:  FLUENT_ELASTICSEARCH_LOGSTASH_PREFIX
            value: "fluentd"
        resources:
          limits:
            memory: 200Mi
          requests:
            cpu: 100m
            memory: 200Mi
        volumeMounts:
        - name: varlog
          mountPath: /var/log
        - name: varlibdockercontainers
          mountPath: /var/lib/docker/containers
          readOnly: true
        - name: config-path
          mountPath: /fluentd/etc
      terminationGracePeriodSeconds: 30
      volumes:
      - name: varlog
        hostPath:
          path: /var/log
      - name: varlibdockercontainers
        hostPath:
          path: /var/lib/docker/containers
      - name: config-source
        configMap:
          name: fluentd-config
      - name: config-path
        emptyDir: {}```

hkailantzis · 2018-10-16T09:24:35Z

tried the above recommendation but it fails with:

adduser: uid '0' in use
chown: unknown user fluent
chown: unknown user fluent
sed: /fluentd/etc/fluent.conf: No such file or directory

Any idea of what I'm doing wrong ? using same fluentd-kubernetes-daemonset:elasticsearch image and trying to configure fluentd via a configMap.

passing the following args in the init container:

cp /fluentd/etc2/system.conf /fluentd/etc/system.conf;
cp /fluentd/etc2/containers.input.conf /fluentd/etc/containers.input.conf;
cp /fluentd/etc2/system.input.conf /fluentd/etc/system.input.conf;
cp /fluentd/etc2/forward.input.conf /fluentd/etc/forward.input.conf;
cp /fluentd/etc2/monitoring.conf /fluentd/etc/monitoring.conf;
cp /fluentd/etc2/output.conf /fluentd/etc/output.conf;

itayariel · 2018-10-16T09:35:56Z

Check this out #173

hkailantzis · 2018-10-16T09:39:28Z

I have FLUENT_UID set to "0". Removed it and now I get:

sed: /fluentd/etc/fluent.conf: No such file or directory

hkailantzis · 2018-10-16T10:12:45Z

it seems that it was expecting fluent.conf to be present. renamed it in my configmap and now works fine.

kurktchiev · 2018-10-16T18:33:42Z

can you elaborate on what you did @hkailantzis

hkailantzis · 2018-10-18T13:26:53Z

hey @kurktchiev. just used the example above posted by "itayariel", but in my case, had to name the config as "fluent.conf" inside my configMap. : e.g.

kind: ConfigMap
apiVersion: v1
metadata:
  name: fluentd-es-config
  namespace: logging
  labels:
    addonmanager.kubernetes.io/mode: Reconcile
data:
  fluent.conf: |-
 .....

coders-kitchen · 2018-11-13T07:31:50Z

wouldn't it be an option to keep the configuration for eg. elasticsearch in the container - where the sed command will work - but move the other configs in a folder like

/etc/fluentd/config.d

and reference it than via

@include /etc/fluentd/config.d/*

which is a mount from the config maps?

Madhansudhan · 2019-05-12T12:38:38Z

kind: ConfigMap
apiVersion: v1
metadata:
name: fluentd-es-config
namespace: logging
labels:
addonmanager.kubernetes.io/mode: Reconcile
data:
fluent.conf: |-

@itayariel & @hkailantzis
Am also getting the same error as "hkailantzis" reported ,
sed: /fluentd/etc/fluent.conf: No such file or directory

Even I have created configmap(fluent.conf) on kube-system namespace as well. <Created a file "fluentd.config" with fluentd configuration, and executed "kubectl create configmap fluent.conf --from-file=fluentd.config --namespace=kube-system >
Please find the events for the pod(fluent)
Events:
Type Reason Age From Message

Normal Scheduled 2m44s default-scheduler Successfully assigned kube-system/fluentd-5gcgr to
Normal Pulled 2m43s kubelet, Container image "busybox" already present on machine
Normal Created 2m43s kubelet, Created container
Normal Started 2m43s kubelet, Started container
Normal Created 2m4s (x4 over 2m43s) kubelet, Created container
Normal Started 2m3s (x4 over 2m43s) kubelet, Started container
Warning BackOff 85s (x9 over 2m41s) kubelet, Back-off restarting failed container
Normal Pulled 74s (x5 over 2m43s) kubelet, Container image "fluent/fluentd-kubernetes-daemonset:elasticsearch" already present on machine
Can some one help me to overcome this please...

github-actions · 2021-03-02T10:14:04Z

This issue has been automatically marked as stale because it has been open 90 days with no activity. Remove stale label or comment or this issue will be closed in 30 days

andrecp · 2021-03-31T23:48:04Z

I'm running into the same issue as @Madhansudhan . I don't quite understand why.

github-actions · 2021-07-01T10:02:41Z

This issue has been automatically marked as stale because it has been open 90 days with no activity. Remove stale label or comment or this issue will be closed in 30 days

github-actions · 2021-07-31T10:02:42Z

This issue was automatically closed because of stale in 30 days

Datise mentioned this issue Oct 23, 2018

Nested JSON parsing stopped working with fluent/fluentd-kubernetes-daemonset:v0.12-debian-elasticsearch fluent/fluentd#2073

Closed

giannello mentioned this issue Dec 10, 2018

Include external configuration files #240

Merged

github-actions bot added the stale label Mar 2, 2021

github-actions bot removed the stale label Apr 1, 2021

github-actions bot added the stale label Jul 1, 2021

github-actions bot closed this as completed Jul 31, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Make the fluentd conf configurable from configMap #174

Make the fluentd conf configurable from configMap #174

vidhy commented Jul 12, 2018

vpistis commented Jul 16, 2018 •

edited

Loading

tuchodi commented Jul 26, 2018

vpistis commented Jul 30, 2018

tuchodi commented Jul 30, 2018

vpistis commented Jul 30, 2018

repeatedly commented Aug 2, 2018

itayariel commented Sep 3, 2018 •

edited

Loading

hkailantzis commented Oct 16, 2018 •

edited

Loading

itayariel commented Oct 16, 2018

hkailantzis commented Oct 16, 2018 •

edited

Loading

hkailantzis commented Oct 16, 2018 •

edited

Loading

kurktchiev commented Oct 16, 2018

hkailantzis commented Oct 18, 2018 •

edited

Loading

coders-kitchen commented Nov 13, 2018

Madhansudhan commented May 12, 2019

github-actions bot commented Mar 2, 2021

andrecp commented Mar 31, 2021

github-actions bot commented Jul 1, 2021

github-actions bot commented Jul 31, 2021

Make the fluentd conf configurable from configMap #174

Make the fluentd conf configurable from configMap #174

Comments

vidhy commented Jul 12, 2018

vpistis commented Jul 16, 2018 • edited Loading

tuchodi commented Jul 26, 2018

vpistis commented Jul 30, 2018

tuchodi commented Jul 30, 2018

vpistis commented Jul 30, 2018

repeatedly commented Aug 2, 2018

itayariel commented Sep 3, 2018 • edited Loading

hkailantzis commented Oct 16, 2018 • edited Loading

itayariel commented Oct 16, 2018

hkailantzis commented Oct 16, 2018 • edited Loading

hkailantzis commented Oct 16, 2018 • edited Loading

kurktchiev commented Oct 16, 2018

hkailantzis commented Oct 18, 2018 • edited Loading

coders-kitchen commented Nov 13, 2018

Madhansudhan commented May 12, 2019

github-actions bot commented Mar 2, 2021

andrecp commented Mar 31, 2021

github-actions bot commented Jul 1, 2021

github-actions bot commented Jul 31, 2021

vpistis commented Jul 16, 2018 •

edited

Loading

itayariel commented Sep 3, 2018 •

edited

Loading

hkailantzis commented Oct 16, 2018 •

edited

Loading

hkailantzis commented Oct 16, 2018 •

edited

Loading

hkailantzis commented Oct 16, 2018 •

edited

Loading

hkailantzis commented Oct 18, 2018 •

edited

Loading