Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Prevent import from generating orphaned files #34070

Merged
merged 3 commits into from
Jun 25, 2024

Conversation

bigsheeper
Copy link
Contributor

When import failed, mark the import segment as dropped instead of drop it directly to prevent generating orphaned files.

issue: #34068

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
@sre-ci-robot sre-ci-robot added the size/XS Denotes a PR that changes 0-9 lines. label Jun 21, 2024
@mergify mergify bot added dco-passed DCO check passed. kind/bug Issues or changes related a bug labels Jun 21, 2024
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
@sre-ci-robot sre-ci-robot added size/S Denotes a PR that changes 10-29 lines. and removed size/XS Denotes a PR that changes 0-9 lines. labels Jun 25, 2024
@mergify mergify bot added the ci-passed label Jun 25, 2024
Copy link

codecov bot commented Jun 25, 2024

Codecov Report

Attention: Patch coverage is 66.66667% with 1 line in your changes missing coverage. Please review.

Project coverage is 80.85%. Comparing base (506a915) to head (305dd99).
Report is 5 commits behind head on master.

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##           master   #34070      +/-   ##
==========================================
+ Coverage   80.81%   80.85%   +0.03%     
==========================================
  Files        1080     1072       -8     
  Lines      137009   137226     +217     
==========================================
+ Hits       110726   110953     +227     
+ Misses      22069    22052      -17     
- Partials     4214     4221       +7     
Files Coverage Δ
internal/datacoord/import_scheduler.go 70.79% <66.66%> (+0.44%) ⬆️

... and 227 files with indirect coverage changes

@czs007
Copy link
Contributor

czs007 commented Jun 25, 2024

/approve
/lgtm

@sre-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: bigsheeper, czs007

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@sre-ci-robot sre-ci-robot merged commit 940a0ac into milvus-io:master Jun 25, 2024
11 of 12 checks passed
sre-ci-robot pushed a commit that referenced this pull request Jun 25, 2024
When import failed, mark the import segment as dropped instead of drop
it directly to prevent generating orphaned files.

issue: #34068

pr: #34070

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
yellow-shine pushed a commit to yellow-shine/milvus that referenced this pull request Jul 2, 2024
When import failed, mark the import segment as dropped instead of drop
it directly to prevent generating orphaned files.

issue: milvus-io#34068

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
bigsheeper added a commit to bigsheeper/milvus that referenced this pull request Jul 12, 2024
…ilvus-io#34071)

When import failed, mark the import segment as dropped instead of drop
it directly to prevent generating orphaned files.

issue: milvus-io#34068

pr: milvus-io#34070

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
bigsheeper added a commit to bigsheeper/milvus that referenced this pull request Jul 12, 2024
…ilvus-io#34071)

When import failed, mark the import segment as dropped instead of drop
it directly to prevent generating orphaned files.

issue: milvus-io#34068

pr: milvus-io#34070

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved ci-passed dco-passed DCO check passed. kind/bug Issues or changes related a bug lgtm size/S Denotes a PR that changes 10-29 lines.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants