Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fetch logs from Elastic Search #190

Open
troeger opened this issue Jun 9, 2021 · 0 comments
Open

Fetch logs from Elastic Search #190

troeger opened this issue Jun 9, 2021 · 0 comments
Assignees

Comments

@troeger
Copy link
Collaborator

troeger commented Jun 9, 2021

The future version of our cluster will put logs into an Elastic Search database through Fluentd. Kubeportal would have a unique feature by fetching log streams for pods / namespaces from such an Elastic Search endpoint, and not the API server.

This issue is intended for a first discussion. I envision the following features:

  • Fluentd marks log entries in Elastic Search with the K8S namespace and K8s pod name creating the log.
  • The Kubeportal backend can be configured with an Elastic Search IP / user name / password, and with the names of the labels for namespace and pod.
  • A new backend API endpoint allows to fetch a stream of logs for a pod. Every request to the Kubeportal backend endpoint leads to an ES query, so the Kubeportal API is just wrapping the log database.
  • The new frontend can show the logs for a pod / deployment, or even complete namespace.

Later, we could add advanced filtering capabilities in the frontend. Another open question is if we want to implement this with WebSockets from the very start.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants