-
Notifications
You must be signed in to change notification settings - Fork 2.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
enhance: optimize datanode cpu usage under large collection number #33267
enhance: optimize datanode cpu usage under large collection number #33267
Conversation
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: xiaofan-luan The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
@xiaofan-luan ut workflow job failed, comment |
105c5f5
to
03b9200
Compare
@xiaofan-luan ut workflow job failed, comment |
03b9200
to
bbc0829
Compare
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## master #33267 +/- ##
==========================================
- Coverage 82.20% 82.04% -0.17%
==========================================
Files 1009 1012 +3
Lines 128855 128858 +3
==========================================
- Hits 105927 105718 -209
- Misses 18944 19159 +215
+ Partials 3984 3981 -3
|
Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
bbc0829
to
a8fe9a9
Compare
func (gc *GroupChecker) Check(name string) { | ||
gc.lastest.Insert(name, time.Now()) | ||
func (gc *CheckerManager) Register(name string, checker *Checker) { | ||
gc.checkers.Insert(name, checker) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It looks like we always create a new one. Should we check if name already exists?
/lgtm |
…ilvus-io#33267) Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
…ilvus-io#33267) fix milvus-io#33266 try to improve cpu usage by refactoring the ttchecker logic and caching string Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com> (cherry picked from commit 36cbce4) Co-authored-by:: jaime <yun.zhang@zilliz.com>
…ilvus-io#33267) fix milvus-io#33266 try to improve cpu usage by refactoring the ttchecker logic and caching string Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com> (cherry picked from commit 36cbce4) Co-authored-by:: jaime <yun.zhang@zilliz.com>
…ilvus-io#33267) fix milvus-io#33266 try to improve cpu usage by refactoring the ttchecker logic and caching string Co-authored-by: xiaofanluan <xiaofan.luan@zilliz.com> (cherry picked from commit 36cbce4) Signed-off-by: jaime <yun.zhang@zilliz.com>
…ilvus-io#33267) fix milvus-io#33266 try to improve cpu usage by refactoring the ttchecker logic and caching string Co-authored-by: yiwangdr <yiwangdr@gmail.com> (cherry picked from commit 36cbce4) Signed-off-by: jaime <yun.zhang@zilliz.com>
…date logic of ttchecker (#34383) This PR cherry-picks the following commits: - Try to improve cpu usage by refactoring the ttchecker logic and caching string. #33267 - Correct the update logic of timerecorder in the flowgraph to avoid false failure: "some node(s) haven't received input". #34339 issue: #33266, #34337 pr: #33267, #34339 --------- Signed-off-by: bigsheeper <yihao.dai@zilliz.com> Co-authored-by: Xiaofan <83447078+xiaofan-luan@users.noreply.github.com>
fix #33266
try to improve cpu usage by refactoring the ttchecker logic and caching string