New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Feature: firehose plugin support #178
Conversation
Thanks for your contribution, but I didn't find firehose output plug-in in the official document, could you please provide me with a document or link? |
Sure, it's part of the AWS for fluentbit, specifically kinesis-firehose. Found some docs here as well 😊 |
@@ -6,7 +6,7 @@ metadata: | |||
labels: | |||
app.kubernetes.io/name: fluent-bit | |||
spec: | |||
image: kubesphere/fluent-bit:v1.8.3 | |||
image: peter-fluentbit:v1.8.10 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
V1.8.3 does not support this plugin, or there is a bug in v1.8.3? If true, we should build a fluent bit image of v1.8.10.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Again, local testing.
|
||
// The Firehose output plugin, allows to ingest your records into AWS Firehose. | ||
// https://github.com/aws/amazon-kinesis-firehose-for-fluent-bit | ||
type Firehose struct { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Variable naming needs to be adjusted. Firstly, it is not recommended to use _
in the definition of crd, for example, delivery_stream
should be changed to deliveryStream
. Secondly, for acronyms, use uppercase, such as Arn => ARN
, Sts => STS
.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Great - I'll fix!
Updated a bit, seems like I confused the old and new version of the firehose plugin. |
api/fluentbitoperator/v1alpha2/plugins/output/firehose_types.go
Outdated
Show resolved
Hide resolved
By the way, please add the |
Download dependencies and binary in Makefile target Signed-off-by: Peter Svensson <peter@sparetimecoders.com>
This plugin add support for the new kinesis_firehose plugin https://docs.fluentbit.io/manual/pipeline/outputs/firehose not the old firehose plugin. Signed-off-by: Peter Svensson <peter@sparetimecoders.com>
No description provided.