Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Logging Infrastructure Rebuild #1297

Closed
dasrecht opened this issue Oct 15, 2019 · 0 comments · Fixed by #1959
Closed

Logging Infrastructure Rebuild #1297

dasrecht opened this issue Oct 15, 2019 · 0 comments · Fixed by #1959
Assignees
@dasrecht
Projects
Lagoon Roadmap (Indicative)

Comments

@dasrecht
Copy link
Contributor

This issue will link all the tickets and discussions together regarding the rebuild of the logging stack within lagoon.

Learnings/Constraints Current Stack

  • Many different Tools involved (logstash, fluentd)
  • No clear monitoring strategy
  • Not 100% outage resistant
  • Outages can lead to buffer buildup which is becoming more and more of a problem as buffers are bound to containers and can't be paralelized

Log collectors

  • application-logs-collector (fluentd)
  • router-logs-collector (fluentd)
  • container-logs-collector (fluentd)

Queuing

  • RabbitMq

Logging Stack Overview - https://www.lucidchart.com/documents/view/b1da011f-2b91-4798-9518-4164b19d327d
@dasrecht dasrecht self-assigned this Oct 15, 2019
@dasrecht dasrecht added the EPIC label Oct 15, 2019
@dasrecht dasrecht mentioned this issue Oct 15, 2019
Closed
@tobybellwood tobybellwood added this to Lagoon 1.5.0 onwards in Lagoon Roadmap (Indicative) Oct 16, 2019
@dasrecht dasrecht mentioned this issue Oct 25, 2019
Closed
@dasrecht dasrecht mentioned this issue Nov 12, 2019
Closed
3 tasks
@smlx smlx mentioned this issue Jan 22, 2020
Closed
3 tasks
@tobybellwood tobybellwood moved this from Lagoon 2.2.0 onwards to Lagoon 2.1.0 (Feb 2020) in Lagoon Roadmap (Indicative) Jan 30, 2020
@smlx smlx mentioned this issue May 8, 2020
Merged
3 tasks
@tobybellwood tobybellwood moved this from Lagoon 1.5.0 (May 2020) to Pre-Lagoon 2.0 in Lagoon Roadmap (Indicative) May 25, 2020
@smlx smlx mentioned this issue Jun 16, 2020
Merged
3 tasks
@tobybellwood tobybellwood removed the EPIC label Jun 17, 2020
Lagoon Roadmap (Indicative) automation moved this from Pre-Lagoon 2.0 to Done Jun 20, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@dasrecht dasrecht

Labels
None yet
Projects
Lagoon Roadmap (Indicative)
Done
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Logging overhaul uselagoon/lagoon
2 participants
@dasrecht @tobybellwood