Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Collect logs with FluentBit and Fluentd #34

Merged
merged 11 commits into from Jun 3, 2019
Merged

Collect logs with FluentBit and Fluentd #34

merged 11 commits into from Jun 3, 2019

Conversation

samjsong
Copy link
Contributor

The goal of this PR is to create a FluentBit daemonset that collects the same logs as the existing Fluentd setup here.

The FluentBit daemonset will send the logs (without any preprocessing to keep it lightweight) to the Fluentd deployment, which acts as an aggregator, attaches the relevant metadata to the logs, then forwards to Sumo.

We make no code changes in this PR - we utilize the FluentBit helm chart to make only config changes. The filter plugin from fluentd-kubernetes-sumologic is copied over as is

Steps for installing (will update the README's in a future PR):

helm install --namespace sumologic --name fluent-bit -f ./deploy/fluent-bit/overrides.yaml stable/fluent-bit
kubectl apply -f ./deploy/kubernetes/fluentd-sumologic.yaml

FYI - @maimaisie @yuting-liu @rvmiller89

@bin3377
Copy link

bin3377 commented May 31, 2019

LGTM. We can add SUMO_ENDPOINT_LOGS source creating in the deployment script. but it can be a separated PR. Thanks!

@samjsong samjsong merged commit 1e4eca3 into master Jun 3, 2019
@samjsong samjsong deleted the ssong-fluentbit branch June 3, 2019 18:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants