promtail: add "max_age" field to configure cutoff for journal reading #921
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
The journal scrape config in promtail has been updated to support
a "cutoff" field. cuttoff determines the oldest journal entry
promtail will read when starting the journal reader. When
unspecified, cutoff defaults to 7h.
Even if a position in the journal is saved in the promtail
positions file, that position may be ignored if the entry corresponding
to that position is older than the cutoff time.
Example promtail config for getting up to the last 12h of journal
entries:
server:
http_listen_port: 9080
grpc_listen_port: 0
positions:
filename: /tmp/positions.yaml
clients:
- url: http://localhost:3100/api/prom/push
scrape_configs:
- job_name: journal
journal:
cutoff: 12h
path: /var/log/journal
labels:
job: systemd-journal
relabel_configs:
- source_labels: ['__journal__systemd_unit']
target_label: 'unit'
|
Should we call this field "since" which would be consistent with the query api? |
|
hrm on second thought I don't like "since", what about "max_age"? |
|
|
rfratto
force-pushed
the
fix-entry-too-old-journal
branch
from
0d00447
to
3f227f5
Compare
rfratto
changed the title
slim-bean
reviewed
Aug 21, 2019
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
The journal scrape config in promtail has been updated to support a "
max_age" field.max_agedetermines the oldest journal entry promtail will read when starting the journal reader. When unspecified,max_agedefaults to 7h.Even if a position in the journal is saved in the promtail positions file, that position may be ignored if the entry corresponding to that position is older than the cutoff time.
Closes #918.
Example promtail config for getting up to the last 12h of journal entries:
Checklist