-
Notifications
You must be signed in to change notification settings - Fork 2.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
enhance: Rename Compaction to CompactionV2 #33858
Conversation
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
test result:
|
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## master #33858 +/- ##
==========================================
- Coverage 80.92% 80.91% -0.01%
==========================================
Files 1058 1058
Lines 135395 135395
==========================================
- Hits 109562 109556 -6
+ Misses 21656 21648 -8
- Partials 4177 4191 +14
|
/approve |
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: bigsheeper, czs007 The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
This PR cherry-picks the following commits: - Implement task limit control logic in datanode. #32881 - Load bf from storage instead of memory during L0 compaction. #32913 - Remove dependencies on shards (e.g. SyncSegments, injection). #33138 - Rename Compaction interface to CompactionV2. #33858 - Remove the unused residual compaction logic. #33932 issue: #32809 pr: #32881, #32913, #33138, #33858, #33932 --------- Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Due to the removal of injection and syncSegments from the compaction, we need to ensure that no compaction is successfully executed during the rolling upgrade. This PR renames Compaction to CompactionV2, with the following effects: - New datacoord + old datanode: Utilizes the CompactionV2 interface, resulting in the datanode error "CompactionV2 not implemented," causing compaction to fail; - Old datacoord + new datanode: Utilizes the CompactionV1 interface, resulting in the datanode error "CompactionV1 not implemented," causing compaction to fail. issue: milvus-io#32809 Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Due to the removal of injection and syncSegments from the compaction, we need to ensure that no compaction is successfully executed during the rolling upgrade. This PR renames Compaction to CompactionV2, with the following effects:
issue: #32809