Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Track container log throttling features as log files are inherently unstable to scrape #5302

Open
portante opened this issue Nov 30, 2020 · 0 comments
Labels
source: file Anything `file` source related type: task Generic non-code related tasks

Comments

@portante
Copy link

portante commented Nov 30, 2020

See containers/conmon#84.

Basically, no matter how good a log scraper is, if it can't keep up with the rate at which logs are written (through no fault of its own), log rotation will cause significant log loss.

Either one has to accept log loss, or we can fix the inherent problems with container logging as described in containers/conmon#84.

One also needs to fix container run times to write logs in a reasonable manner (not interpreting the byte stream, that is for the log reader, or later, to do), see containers/conmon#265.

@portante portante added the type: task Generic non-code related tasks label Nov 30, 2020
@binarylogic binarylogic added the source: file Anything `file` source related label Nov 30, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
source: file Anything `file` source related type: task Generic non-code related tasks
Projects
None yet
Development

No branches or pull requests

2 participants