Skip to content

Update fluentbit helm values to include stream file #2

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Nov 7, 2022
Merged

Update fluentbit helm values to include stream file #2

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
70 changes: 42 additions & 28 deletions charts/demo/values.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@
# Declare variables to be passed into your templates.

global:
domain: d.getsmarter.io
domain: d.getsmarter.io

fluent-bit:
fluentd:
host: fluentbit
Expand All @@ -18,6 +18,19 @@ fluent-bit:
effect: "NoSchedule"
hostname: smarter-fluent-bit
config:
service: |
[SERVICE]
Daemon Off
Flush {{ .Values.flush }}
Log_Level {{ .Values.logLevel }}
Parsers_File parsers.conf
Parsers_File custom_parsers.conf
HTTP_Server On
HTTP_Listen 0.0.0.0
HTTP_Port {{ .Values.metricsPort }}
Health_Check On
Streams_File mqtt-split.conf

inputs: |
[INPUT]
name cpu
Expand Down Expand Up @@ -84,37 +97,39 @@ fluent-bit:
Match weatherbit_count
Record hostname ${HOSTNAME}

[STREAM_TASK]
Name car_count
Exec CREATE STREAM car_count AS SELECT * FROM STREAM:mqttdata WHERE topic = '/demo/car_count';
extraFiles:
mqtt-split.conf: |
[STREAM_TASK]
Name car_count
Exec CREATE STREAM car_count AS SELECT * FROM STREAM:mqttdata WHERE topic = '/demo/car_count';

[STREAM_TASK]
Name person_count
Exec CREATE STREAM person_count AS SELECT * FROM STREAM:mqttdata WHERE topic = '/demo/person_count';
[STREAM_TASK]
Name person_count
Exec CREATE STREAM person_count AS SELECT * FROM STREAM:mqttdata WHERE topic = '/demo/person_count';

[STREAM_TASK]
Name bus_count
Exec CREATE STREAM bus_count AS SELECT * FROM STREAM:mqttdata WHERE topic = '/demo/bus_count';
[STREAM_TASK]
Name bus_count
Exec CREATE STREAM bus_count AS SELECT * FROM STREAM:mqttdata WHERE topic = '/demo/bus_count';

[STREAM_TASK]
Name bicycle_count
Exec CREATE STREAM bicycle_count AS SELECT * FROM STREAM:mqttdata WHERE topic = '/demo/bicycle_count';
[STREAM_TASK]
Name bicycle_count
Exec CREATE STREAM bicycle_count AS SELECT * FROM STREAM:mqttdata WHERE topic = '/demo/bicycle_count';

[STREAM_TASK]
Name motorcycle_count
Exec CREATE STREAM motorcycle_count AS SELECT * FROM STREAM:mqttdata WHERE topic = '/demo/motorcycle_count';
[STREAM_TASK]
Name motorcycle_count
Exec CREATE STREAM motorcycle_count AS SELECT * FROM STREAM:mqttdata WHERE topic = '/demo/motorcycle_count';

[STREAM_TASK]
Name sound_class
Exec CREATE STREAM sound_class AS SELECT * FROM STREAM:mqttdata WHERE topic = '/demo/sound_class';
[STREAM_TASK]
Name sound_class
Exec CREATE STREAM sound_class AS SELECT * FROM STREAM:mqttdata WHERE topic = '/demo/sound_class';

[STREAM_TASK]
Name pms7003_count
Exec CREATE STREAM pms7003_count AS SELECT * FROM STREAM:mqttdata WHERE topic = '/demo/pms7003';
[STREAM_TASK]
Name weatherbit_count
Exec CREATE STREAM weatherbit_count AS SELECT * FROM STREAM:mqttdata WHERE topic = '/demo/weatherbit';
[STREAM_TASK]
Name pms7003_count
Exec CREATE STREAM pms7003_count AS SELECT * FROM STREAM:mqttdata WHERE topic = '/demo/pms7003';

[STREAM_TASK]
Name weatherbit_count
Exec CREATE STREAM weatherbit_count AS SELECT * FROM STREAM:mqttdata WHERE topic = '/demo/weatherbit';

outputs: |
[OUTPUT]
Expand Down Expand Up @@ -168,4 +183,3 @@ fluent-bit:
Regex ^\<(?<pri>[0-9]+)\>(?<time>[^ ]* {1,2}[^ ]* [^ ]*) (?<host>[^ ]*) (?<ident>[a-zA-Z0-9_\/\.\-]*)(?:\[(?<pid>[0-9]+)\])?(?:[^\:]*\:)? *(?<message>.*)$
Time_Key time
Time_Format %b %d %H:%M:%S