Prometheus do not update config for fluent bit metrics.

[antonLebiedyntsev]

Using helm chart of prometheus operator.
Added config for prometheus operator for

• name: "fluentbit-metrics-monitor" selector: matchLabels: app: fluent-bit namespaceSelector: matchNames: - logging endpoints: - port: "metrics" interval: 30s path: /api/v1/metrics/prometheus additionalPodMonitors: []

Fluentbit provides metrics as expected.

For some reason prometheus do not update config and do not add targets.

Prometheus operator version helm prometheus-operator-8.2.16 app version 0.34.0.
Fluentbit helm chart fluent-bit-2.8.3 app version 1.3.2

[antonLebiedyntsev]

Helm chart worked as expected. Service monitor created as expected. But prometheus did not reload and did not updated prometheus config.

even after restart of prometheus operator and prometheus pods - nothing changes and service monitor do not get updated.

I've even tried to delete old one service monitors and nothing gets changed at all.
Thats behavior looks incorrect. Here is a part of values file config that I successfully used for adding other service monitors:

  additionalServiceMonitors:
...
<Old service monitors that works as expected>
...
  - name: "fluentbit-metrics-monitor"
    selector:
      matchLabels:
        app: fluent-bit
    namespaceSelector:
      matchNames:
        - logging
    endpoints:
      - port: "metrics"
        interval: 30s
        path: /api/v1/metrics/prometheus

  additionalPodMonitors: []

I did helm upgrade with this values and I do not see any updates on Prometheus Targets, nothing gets changed in Prometheus config.

Fluentbit metrics get propagated under /api/v1/metrics/prometheus as expected and I can fetch them manually.

is there any option to force reload on prometheus config?

[gkarthiks]

Hi @antonLebiedyntsev the stable/prometheus chart has been deprecated effectively as per this PR #23692 on Sep 5, 2020 and moved to https://github.com/prometheus-community/helm-charts.

Please close this Issue and re-open against the prometheus-community/helm-charts repo. Here's a friendly link for new issue

We hope to see you there. 👋