Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: 大业务量环境下job-manage CPU持续飚高 #2114

Closed
jsonwan opened this issue Jun 7, 2023 · 1 comment
Closed

fix: 大业务量环境下job-manage CPU持续飚高 #2114

jsonwan opened this issue Jun 7, 2023 · 1 comment
Assignees
Labels
done 已上线到正式环境并验收通过 for test 可以在测试环境进行验收 kind/bug 程序故障Bug,漏洞

Comments

@jsonwan
Copy link
Collaborator

jsonwan commented Jun 7, 2023

Version / Branch / tag
3.6.x,master

出了什么问题?(What Happened?)
大业务量环境下job-manage CPU持续飚高至90%以上。
排查发现,原因在于job-manage中某处代码使用parallelStream造成多个线程并发地向同一个Set里面添加元素。
image

如何复现?(How to reproduce?)
大业务量环境下,作业、主机等资源数量较多,统计分析任务持续运行的情况下,job-manage CPU持续飚高至90%以上。

预期结果(What you expect?)
job-manage CPU占用保持健康状态,不超过70%。

@jsonwan jsonwan added kind/bug 程序故障Bug,漏洞 backlog 需求初始状态,等待产品进行评估 todo 进入开发排期的状态,纳入了最近的迭代 labels Jun 7, 2023
@jsonwan jsonwan self-assigned this Jun 7, 2023
@jsonwan
Copy link
Collaborator Author

jsonwan commented Jun 7, 2023

排查整个项目中parallelStream使用,将不必要的使用改为stream()

jsonwan added a commit to jsonwan/bk-job that referenced this issue Jun 7, 2023
排查所有parallelStream(),将不必要的使用替换为stream()
wangyu096 added a commit that referenced this issue Jun 7, 2023
fix: 大业务量环境下job-manage CPU持续飚高 #2114
@bkjob-bot bkjob-bot added for test 可以在测试环境进行验收 for gray 可以在灰度环境/预发布环境验收 done 已上线到正式环境并验收通过 and removed backlog 需求初始状态,等待产品进行评估 todo 进入开发排期的状态,纳入了最近的迭代 for test 可以在测试环境进行验收 for gray 可以在灰度环境/预发布环境验收 labels Jun 15, 2023
@bkjob-bot bkjob-bot added the for test 可以在测试环境进行验收 label Jun 26, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
done 已上线到正式环境并验收通过 for test 可以在测试环境进行验收 kind/bug 程序故障Bug,漏洞
Projects
None yet
Development

No branches or pull requests

2 participants