Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug][Manager] The number of StreamSource is too large, resulting in high CPU usage #7577

Closed
2 tasks done
fuweng11 opened this issue Mar 13, 2023 · 0 comments · Fixed by #7578
Closed
2 tasks done

[Bug][Manager] The number of StreamSource is too large, resulting in high CPU usage #7577

fuweng11 opened this issue Mar 13, 2023 · 0 comments · Fixed by #7578
Assignees
@fuweng11
Labels
component/manager type/bug Something is wrong
Milestone
1.6.0

Comments

@fuweng11
Copy link
Contributor

fuweng11 commented Mar 13, 2023 •
edited by dockerzhang

What happened

When too many agents are deployed, a large number of StreamSource instances are generated when the agent pulls tasks from the manager, leading to a large number of GC.The result is CPU100%.

What you expected to happen

The manager does not generate too many streamSource instances when pulling tasks.

企业微信截图_d978311a-ebb5-4773-a814-ce0bff687feb

How to reproduce

More than 100 agents are deployed.

Environment

No response

InLong version

master

InLong Component

InLong Manager

Are you willing to submit PR?

  • Yes, I am willing to submit a PR!

Code of Conduct
@fuweng11 fuweng11 added the type/bug Something is wrong label Mar 13, 2023
@fuweng11 fuweng11 mentioned this issue Mar 13, 2023
Merged
@healchow healchow added this to the 1.6.0 milestone Mar 13, 2023
@healchow healchow changed the title [Bug][Manager]If the agent exceeds 200, CPU 100% will be generated. [Bug][Manager] The number of StreamSource is too large, resulting in high CPU usage Mar 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@fuweng11 fuweng11

Labels
component/manager type/bug Something is wrong
Projects
None yet
Milestone
1.6.0
2 participants
@healchow @fuweng11