You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: concepts/data-pipeline/parser.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,7 +6,7 @@ description: Convert Unstructured to Structured messages
6
6
7
7
Dealing with raw strings or unstructured messages is a constant pain; having a structure is highly desired. Ideally we want to set a structure to the incoming data by the Input Plugins as soon as they are collected:
The Parser allows you to convert from unstructured to structured data. As a demonstrative example consider the following Apache \(HTTP Server\) log entry:
Copy file name to clipboardExpand all lines: installation/docker.md
+1Lines changed: 1 addition & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -76,3 +76,4 @@ Alpine Linux uses Musl C library instead of Glibc. Musl is not fully compatible
76
76
Our Docker containers images are deployed thousands of times per day, we take security and stability very seriously.
77
77
78
78
The _latest_ tag _most of the time_ points to the latest stable image. When we release a major update to Fluent Bit like for example from v1.3.x to v1.4.0, we don't move _latest_ tag until 2 weeks after the release. That give us extra time to verify with our community that everything works as expected.
Copy file name to clipboardExpand all lines: installation/sources/download-source-code.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,9 +2,9 @@
2
2
3
3
## Stable
4
4
5
-
For production systems, we strongly suggest that you always get the latest stable release from our web site, you can get the official tarballs \(.tar.gz\) from the following link:
5
+
For production systems, we strongly suggest that you always get the latest stable release from our web site, you can get the official tarballs \(.tar.gz\) from using the following link pattern:
https://fluentbit.io/release/1.7/fluent-bit-<release version>. For example for version 1.7.4 the link is the following: [https://fluentbit.io/releases/1.7/fluent-bit-1.7.4.tar.gz](https://fluentbit.io/releases/1.7/fluent-bit-1.7.4.tar.gz)
Copy file name to clipboardExpand all lines: pipeline/inputs/tail.md
+3-4Lines changed: 3 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -24,7 +24,7 @@ The plugin supports the following configuration parameters:
24
24
| DB | Specify the database file to keep track of monitored files and offsets. ||
25
25
| DB.sync | Set a default synchronization \(I/O\) method. Values: Extra, Full, Normal, Off. This flag affects how the internal SQLite engine do synchronization to disk, for more details about each option please refer to [this section](https://www.sqlite.org/pragma.html#pragma_synchronous). Most of workload scenarios will be fine with `normal` mode, but if you really need full synchronization after every write operation you should set `full` mode. Note that `full` has a high I/O performance cost. | normal |
26
26
| DB.locking | Specify that the database will be accessed only by Fluent Bit. Enabling this feature helps to increase performance when accessing the database but it restrict any external tool to query the content. | false |
27
-
| DB.journal_mode| sets the journal mode for databases \(WAL\). Enabling WAL provides higher performance. Note that WAL is not compatible with shared network file systems. | WAL |
27
+
| DB.journal\_mode| sets the journal mode for databases \(WAL\). Enabling WAL provides higher performance. Note that WAL is not compatible with shared network file systems. | WAL |
28
28
| Mem\_Buf\_Limit | Set a limit of memory that Tail plugin can use when appending data to the Engine. If the limit is reach, it will be paused; when the data is flushed it resumes. ||
29
29
| exit\_on\_eof | When reading a file will exit as soon as it reach the end of the file. Useful for bulk load and tests | false |
30
30
| Parser | Specify the name of a parser to interpret the entry as a structured message. ||
@@ -198,12 +198,11 @@ Those two files aims to support the `WAL` mechanism that helps to improve perfor
198
198
199
199
### WAL and Memory Usage
200
200
201
-
The `WAL` mechanism give us higher performance but also might increase the memory usage by Fluent Bit. Most of this usage comes from the memory mapped and cached pages. In some cases you might see that memory usage keeps a bit high giving the impression of a memory leak, but actually is not relevant unless you want your memory metrics back to normal.
202
-
Starting from Fluent Bit v1.7.3 we introduced the new option ```db.journal_mode``` mode that sets the journal mode for databases, by default it will be ```WAL (Write-Ahead Logging)```, currently allowed configurations for ```db.journal_mode``` are ```DELETE | TRUNCATE | PERSIST | MEMORY | WAL | OFF``` .
203
-
201
+
The `WAL` mechanism give us higher performance but also might increase the memory usage by Fluent Bit. Most of this usage comes from the memory mapped and cached pages. In some cases you might see that memory usage keeps a bit high giving the impression of a memory leak, but actually is not relevant unless you want your memory metrics back to normal. Starting from Fluent Bit v1.7.3 we introduced the new option `db.journal_mode` mode that sets the journal mode for databases, by default it will be `WAL (Write-Ahead Logging)`, currently allowed configurations for `db.journal_mode` are `DELETE | TRUNCATE | PERSIST | MEMORY | WAL | OFF` .
204
202
205
203
## File Rotation
206
204
207
205
File rotation is properly handled, including logrotate's _copytruncate_ mode.
208
206
209
207
Note that the `Path` patterns **cannot** match the rotated files. Otherwise, the rotated file would be read again and lead to duplicate records.
0 commit comments