Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Emitter storage_type and mem_buf_limit config #1069

Merged
merged 1 commit into from Feb 29, 2024

Conversation

chrono2002
Copy link

What this PR does / why we need it:

Adds an ability to specify emitter storage type (fs or memory) and emitter buffer size.

Which issue(s) this PR fixes:

Fixes fluent/fluent-bit#4940

Does this PR introduced a user-facing change?

None

Additional documentation, usage docs, etc.:

filters:

  • rewriteTag:
    emitterName: rewrite_em
    emitterStorageType: filesystem
    emitterMemBufLimit: 128MB

  • multiline:
    emitterName: multiline_em
    emitterStorageType: filesystem
    emitterMemBufLimit: 128MB
    keyContent: log
    parser: python

@chrono2002 chrono2002 changed the title Emitter storage type and membuflimit proposal feat: Emitter storage type and membuflimit configure Feb 21, 2024
@chrono2002 chrono2002 changed the title feat: Emitter storage type and membuflimit configure feat: Emitter storage type and membuflimit config Feb 21, 2024
@chrono2002 chrono2002 changed the title feat: Emitter storage type and membuflimit config feat: Emitter storage type and mem_buf_limit config Feb 21, 2024
@chrono2002 chrono2002 changed the title feat: Emitter storage type and mem_buf_limit config feat: Emitter storage_type and mem_buf_limit config Feb 21, 2024
@benjaminhuo
Copy link
Member

@chrono2002 You'll need to sign your commit by

git commit -s --amend
git push -f

Signed-off-by: Paul Smith <chrono2002@gmail.com>
@chrono2002
Copy link
Author

@chrono2002 You'll need to sign your commit by

git commit -s --amend
git push -f

done

@benjaminhuo
Copy link
Member

@chrono2002 Thank you!

@benjaminhuo benjaminhuo merged commit 6de723c into fluent:master Feb 29, 2024
6 checks passed
@antrema
Copy link
Collaborator

antrema commented Apr 4, 2024

@chrono2002 you didn't use the make manifests to generate the CRDs, so your modifications will be deleted each time the make manifests command will be played

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Multiline filter crashes after buffer limit is reached causing high cpu and memory usage
3 participants