Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[cni-cilium] Cilium Hubble high cpu usage #3078

Open
2 tasks done
Tracked by #1632
RomanenkoDenys opened this issue Nov 20, 2022 · 1 comment
Open
2 tasks done
Tracked by #1632

[cni-cilium] Cilium Hubble high cpu usage #3078

RomanenkoDenys opened this issue Nov 20, 2022 · 1 comment
Assignees
Labels
area/monitoring Pull requests that update monitoring modules area/network Pull requests that update cni and network modules priority/backlog Issues that have the least priority source/deckhouse-team Issue created by Deckhouse team

Comments

@RomanenkoDenys
Copy link
Member

Preflight Checklist

  • I agree to follow the Code of Conduct that this project adheres to.
  • I have searched the issue tracker for an issue that matches the one I want to file, without success.

Version

v1.39

Expected Behavior

When we enable Hubble observability for Cilium cni, cpu usage by cilium agents should not be very high.

Actual Behavior

In clusters with high traffic rate when we enable Hubble observability for Cilium cni, cilium agents on nodes consumes many cpu resources.
When we disable Hubble observability, cpu usage on nodes comes back to normal.
image
Difference beween cpu usage on node in case of enabled Hubble and disabled Hubble is more than 10 times.

Steps To Reproduce

  1. Install cluster with cni cilium enabled.
  2. Enable Hubble.

Additional Information

No response

Logs

No response

@RomanenkoDenys RomanenkoDenys added area/monitoring Pull requests that update monitoring modules area/network Pull requests that update cni and network modules labels Nov 20, 2022
@nabokihms nabokihms changed the title Cilium Hubble high cpu usage [cni-cilium] Cilium Hubble high cpu usage Nov 20, 2022
@EvgenySamoylov EvgenySamoylov added source/deckhouse-team Issue created by Deckhouse team priority/backlog Issues that have the least priority labels Nov 23, 2022
@deckhouse-BOaTswain
Copy link
Collaborator

This issue has been automatically put in the triage queue because it has not had
recent activity. The team will reconsider the status of this issue. Thank you
for your contributions.

@deckhouse-BOaTswain deckhouse-BOaTswain added the status/needs-triage Issues or PRs awaiting triage. label Mar 25, 2023
@raabdullaev raabdullaev removed the status/needs-triage Issues or PRs awaiting triage. label Jul 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/monitoring Pull requests that update monitoring modules area/network Pull requests that update cni and network modules priority/backlog Issues that have the least priority source/deckhouse-team Issue created by Deckhouse team
Projects
None yet
Development

No branches or pull requests

5 participants