-
Notifications
You must be signed in to change notification settings - Fork 2.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
enhance: limit the max pool size to 16 #30371
Conversation
@yah01 E2e jenkins job failed, comment |
according to our benchmark, concurrency level 16 is enough to fully utilize the object storage network bandwidth Signed-off-by: yah01 <yang.cen@zilliz.com>
adca68a
to
c7e30c2
Compare
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## master #30371 +/- ##
==========================================
+ Coverage 79.83% 83.25% +3.42%
==========================================
Files 954 707 -247
Lines 134860 114892 -19968
==========================================
- Hits 107660 95649 -12011
+ Misses 23538 15579 -7959
- Partials 3662 3664 +2
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
/lgtm
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: congqixia, yah01 The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
according to our benchmark, concurrency level 16 is enough to fully utilize the object storage network bandwidth Signed-off-by: yah01 <yang.cen@zilliz.com>
Revert "enhance: reduce many I/O operations while loading disk index (milvus-io#30189) (milvus-io#30690)" This reverts commit d4c4bf9. Revert "enhance: limit the max pool size to 16 (milvus-io#30371) (milvus-io#30415)" This reverts commit 52ac071. Revert "enhance: convert the `GetObject` util to async (milvus-io#30166) (milvus-io#30197)" This reverts commit 4b7c5ba. Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Revert "enhance: reduce many I/O operations while loading disk index (#30189) (#30690)" This reverts commit d4c4bf9. Revert "enhance: limit the max pool size to 16 (#30371) (#30415)" This reverts commit 52ac071. Revert "enhance: convert the `GetObject` util to async (#30166) (#30197)" This reverts commit 4b7c5ba. Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
Signed-off-by: MrPresent-Han <chun.han@zilliz.com> add vchannel to stats path
Signed-off-by: MrPresent-Han <chun.han@zilliz.com> add vchannel to stats path
Signed-off-by: MrPresent-Han <chun.han@zilliz.com> add vchannel to stats path
Signed-off-by: MrPresent-Han <chun.han@zilliz.com> add vchannel to stats path
according to our benchmark, concurrency level 16 is enough to fully utilize the object storage network bandwidth