Skip to content

Commit

Permalink
update architecture diagram
Browse files Browse the repository at this point in the history
Signed-off-by: zhu733756 <zhu733756@kubesphere.io>
  • Loading branch information
zhu733756 committed Feb 10, 2022
1 parent ef9f98c commit dd64a30
Show file tree
Hide file tree
Showing 2 changed files with 47 additions and 25 deletions.
3 changes: 2 additions & 1 deletion docs/images/fluent-operator.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
69 changes: 45 additions & 24 deletions docs/proposals/fluent_operator_20210907.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,29 +2,50 @@

## Table of contents

- [Introduction](#Introduction)
- [Why adding Fluentd CRDs to Fluent Operator? ](#Why-adding-Fluentd-CRDs-to-Fluent-Operator? )
- [How to integrate fluentd ?](#How-to-integrate-fluentd)
- [Introduction to the types of CRD](#Introduction-to-the-types-of-CRD-and-workflow)
- [Support for namespaces isolation and cloud native selectors](#Support-for-namespaces-isolation-and-cloud-native-selectors)
- [Support for strict configuration validation](#Support-for-strict-configuration-validation)
- [Select popular Fluentd plugins to add CRD support](#Select-popular-fluentd-plugins-to-add-crd-support)
- [Support for custom plugins installation](#Support-for-custom-plugins-installation)
- [Enable filesystem pvc for buffer](#Enable-filesystem-pvc-for-buffer)
- [Add ClusterDirectives CRD to support directives predefined](#Add-ClusterDirectives-CRD-to-support-directives-predefined)
- [Fluentd CRDs Design](#Fluentd-CRDs-Design)
- [Fluentd CRD](#Fluentd-CRD)
- [FluentdClusterConfig CRD Or FluentdConfig CRD](#FluentdClusterConfig-CRD-Or-FluentdConfig-CRD)
- [Output CRD Or ClusterOutput CRD](#Output-CRD-Or-ClusterOutput-CRD)
- [Configuration Supplement](#Configuration-Supplement)
- [Common Directive Configuration Supplement](#Common-Directive-Configuration-Supplement)
- [Buffer Directive Configuration Supplement](#Buffer-Directive-Configuration-Supplement)
- [Format Directive Configuration Supplement](#Format-Directive-Configuration-Supplement)
- [Inject Directive Configuration Supplement](#Inject-Directive-Configuration-Supplement)
- [Transport Directive Configuration Supplement](#Transport-Directive-Configuration-Supplement)
- [Storage Directive Configuration Supplement](#Storage-Directive-Configuration-Supplement)
- [Service Discovery Directive Configuration Supplement](#Service-Discovery-Directive-Configuration-Supplement)
- [Parts that need to be discussed or added](#Parts-that-need-to-be-discussed-or-added)
- [Proposal: Add Fluentd to Fluent Operator as an optional log aggregation and forwarding layer](#proposal-add-fluentd-to-fluent-operator-as-an-optional-log-aggregation-and-forwarding-layer)
- [Table of contents](#table-of-contents)
- [Introduction](#introduction)
- [FluentBit CRDs refactoring](#fluentbit-crds-refactoring)
- [Why adding Fluentd CRDs to Fluent Operator?](#why-adding-fluentd-crds-to-fluent-operator)
- [How to integrate fluentd?](#how-to-integrate-fluentd)
- [Introduction to the types of CRD and workflow:](#introduction-to-the-types-of-crd-and-workflow)
- [Support for namespaces isolation and cloud native selectors](#support-for-namespaces-isolation-and-cloud-native-selectors)
- [Support for strict configuration validation](#support-for-strict-configuration-validation)
- [Select popular Fluentd plugins to add CRD support](#select-popular-fluentd-plugins-to-add-crd-support)
- [Support for custom plugins installation](#support-for-custom-plugins-installation)
- [Enable filesystem pvc for buffer](#enable-filesystem-pvc-for-buffer)
- [Add ClusterDirectives CRD to support directives predefined](#add-clusterdirectives-crd-to-support-directives-predefined)
- [Fluentd CRDs Design](#fluentd-crds-design)
- [Fluentd CRD](#fluentd-crd)
- [FluentdClusterConfig CRD Or FluentdConfig CRD](#fluentdclusterconfig-crd-or-fluentdconfig-crd)
- [Input Section Of FluentdClusterConfig CRD or FluentdConfig CRD](#input-section-of-fluentdclusterconfig-crd-or-fluentdconfig-crd)
- [forward](#forward)
- [http](#http)
- [Filters Section Of the FluentdClusterConfig Crd or FluentdConfig Crd](#filters-section-of-the-fluentdclusterconfig-crd-or-fluentdconfig-crd)
- [record_transformer](#record_transformer)
- [grep](#grep)
- [parser](#parser)
- [stdout](#stdout)
- [Output CRD Or ClusterOutput CRD](#output-crd-or-clusteroutput-crd)
- [forward](#forward-1)
- [http](#http-1)
- [stdout](#stdout-1)
- [kafka](#kafka)
- [elasticsearch](#elasticsearch)
- [s3](#s3)
- [Configuration Supplement](#configuration-supplement)
- [Common Directive Configuration Supplement](#common-directive-configuration-supplement)
- [type](#type)
- [id](#id)
- [log_level](#log_level)
- [label](#label)
- [Buffer Directive Configuration Supplement](#buffer-directive-configuration-supplement)
- [Format Directive Configuration Supplement](#format-directive-configuration-supplement)
- [Inject Directive Configuration Supplement](#inject-directive-configuration-supplement)
- [Transport Directive Configuration Supplement](#transport-directive-configuration-supplement)
- [Storage Directive Configuration Supplement](#storage-directive-configuration-supplement)
- [Service Discovery Directive Configuration Supplement](#service-discovery-directive-configuration-supplement)
- [Parts that need to be discussed or added](#parts-that-need-to-be-discussed-or-added)


## Introduction
Expand All @@ -43,7 +64,7 @@ Now all FluentBit CRDs are namespace level. We should use cluster level CRDs for

The following table from [Fluent Bit documentation](https://docs.fluentbit.io/manual/about/fluentd-and-fluent-bit) describes a comparison in different areas of the two projects:

![image-20210618114950689](https://raw.githubusercontent.com/zhu733756/bedpic/main/images/image-20210618114950689.png)
![image-20210618114950689](https://raw.githubusercontent.com/fluent/fluentbit-operator/master/docs/images/fluent-operator.svg)

The rich plugins is one of the reasons, which helps to do better handling of logging in some complex scenarios.

Expand Down

0 comments on commit dd64a30

Please sign in to comment.