Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for Stateless Mode #4596

Open
ryanfaircloth opened this issue Aug 19, 2023 · 0 comments
Open

Support for Stateless Mode #4596

ryanfaircloth opened this issue Aug 19, 2023 · 0 comments

Comments

@ryanfaircloth
Copy link
Contributor

Description of the problem

When using syslog-ng in a hub and spoke pattern it is desirable to scale up and own the number of instances based on throughput needs. When using memory queues and excluding file queues and when no other stateful needs such as python check points syslog-ng should be able to handle a stop signal to shut down in a graceful way with no data loss caused.

Proposed solution

  • The term signal is received
  • Source models as closed/terminated, it is important to note how this is done is on a case by case basis and may require source side enhancement. For the initial release syslog,network,file,named-pipe,program, journald,otel,http and files would cover most instances. A configurable shut down time for this phase is desirable
  • After all sources have closed monitor the queue depth of destinations until each reaches zero or a timer expires. The total shutdown timer should begin at the time the signal is received

Alternatives

External proxy, connection management to drain considered to difficult.

Additional context

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant