Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Documentation enhancement] Server hangs due to rsyslog running out of queue space #3572

Open
rhessing opened this issue Mar 27, 2019 · 3 comments

Comments

@rhessing
Copy link

I've noticed that when the remote syslog server is not available rsyslog will 'hang on' to the logs until it is back online. However, if the queue runs out of queue space then the inputs begin to block, which causes the log socket to block and finally the apps (including the kernel) that write to the log socket will hang causing a system wide hang.

According to other issues in regards to this topic this is the default rsyslog behavior unless rsyslog is configured in such a way that it knows when to discard log messages or write it to local disk.

Could we please add this behavior to the documentation? I only found a short mention here:
https://www.rsyslog.com/doc/master/rainerscript/queue_parameters.html?highlight=hang#queue-timeoutenqueue

But I believe this requires a more prominent position within the documentation such as here:
https://www.rsyslog.com/doc/master/troubleshooting/index.html#typical-problems

@rhessing rhessing changed the title [Documentation enhancement] Server hangs due to rsyslog runs out of queue space [Documentation enhancement] Server hangs due to rsyslog running out of queue space Mar 27, 2019
@rgerhards
Copy link
Member

However, if the queue runs out of queue space then the inputs begin to block, which causes the log socket to block

It's not actually blocking, but the main queue timeout is 2sec (per msg). So it drains veeery slowly.

But I believe this requires a more prominent position within the documentation such as here:
https://www.rsyslog.com/doc/master/troubleshooting/index.html#typical-problems

ack - are you up for a PR?

@rgerhards
Copy link
Member

doc source is here, just in case: https://github.com/rsyslog/rsyslog-doc

@rhessing
Copy link
Author

Sure, I'll create a PR

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants