Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

(db/snapshots): Integration and Enhancement #2673

Merged
merged 28 commits into from
Jul 1, 2020
Merged

Conversation

XuPeng-SH
Copy link
Contributor

What type of PR is this?

api-change / bug / improvement / documentation / feature

Need this PR be picked to master branch?

Yes / No

Which issue(s) this PR fixes:

Fixes #

What this PR does / why we need it:

Special notes for your reviewer:

Additional documentation (e.g. design docs, usage docs, etc.):

@XuPeng-SH XuPeng-SH added kind/feature Issues related to feature request from users automerge labels Jun 26, 2020
@XuPeng-SH XuPeng-SH requested a review from wxyucs as a code owner June 26, 2020 03:52
@XuPeng-SH XuPeng-SH added this to In progress in 0.11.0 via automation Jun 26, 2020
@XuPeng-SH XuPeng-SH linked an issue Jun 26, 2020 that may be closed by this pull request
@codecov
Copy link

codecov bot commented Jun 26, 2020

Codecov Report

Merging #2673 into master will decrease coverage by 0.60%.
The diff coverage is 5.68%.

@@            Coverage Diff             @@
##           master    #2673      +/-   ##
==========================================
- Coverage   78.92%   78.32%   -0.61%     
==========================================
  Files         428      432       +4     
  Lines       27510    27762     +252     
==========================================
+ Hits        21713    21744      +31     
- Misses       5797     6018     +221     
Impacted Files Coverage Δ
core/src/db/DB.h 100.00% <ø> (ø)
core/src/db/DBImpl.h 100.00% <ø> (ø)
core/src/db/SnapshotHandlers.cpp 0.00% <0.00%> (ø)
core/src/db/SnapshotHandlers.h 0.00% <0.00%> (ø)
core/src/db/SnapshotVisitor.cpp 0.00% <0.00%> (ø)
core/src/db/snapshot/CompoundOperations.cpp 0.00% <0.00%> (ø)
core/src/db/snapshot/Resources.cpp 0.00% <0.00%> (ø)
core/src/db/snapshot/Resources.h 0.00% <0.00%> (ø)
core/src/db/snapshot/ScopedResource.h 0.00% <ø> (ø)
core/src/db/snapshot/Snapshot.cpp 0.00% <0.00%> (ø)
... and 27 more

core/src/db/DB.h Outdated Show resolved Hide resolved
core/src/db/DBImpl.cpp Outdated Show resolved Hide resolved
@mergify
Copy link
Contributor

mergify bot commented Jun 29, 2020

This pull request is now in conflicts. Could you fix it? 🙏

@JinHai-CN JinHai-CN added this to In progress in Data Management via automation Jun 29, 2020
@JinHai-CN JinHai-CN removed this from In progress in 0.11.0 Jun 29, 2020
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: peng.xu <peng.xu@zilliz.com>
@XuPeng-SH XuPeng-SH requested a review from cydrain July 1, 2020 06:15
@@ -11,6 +11,7 @@

#pragma once

#include <map>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

removable

SSDBImpl::DropCollection(const std::string& name) {
CHECK_INITIALIZED;

// dates partly delete files of the collection but currently we don't support
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this comment seems not readable

return Status::OK();
}
if (context_ && context_->IsConnectionBroken()) {
LOG_ENGINE_DEBUG_ << "Client connection broken, stop load collection";
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

stop loading


// SS TODO
auto element_handler = std::make_shared<LoadVectorFieldElementHandler>(context_, ss_, field);
element_handler->Iterate();
Copy link
Contributor

@cydrain cydrain Jul 1, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it's not clear what "Iterate()" does internally.
Is it possible write the code in this way:

for (auto elem_iter = element_handler->begin(); elem_iter != element_handler->end(); elem_iter = element_handler->next()) {
    /* do something */
}

@@ -24,8 +24,10 @@ using NUM_TYPE = int64_t;
using FTYPE_TYPE = int64_t;
using TS_TYPE = int64_t;
using LSN_TYPE = uint64_t;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

suggest to use int64_t everywhere for ease of debug

Data Management automation moved this from In progress to Reviewer approved Jul 1, 2020
@mergify mergify bot merged commit a4b2c2b into milvus-io:master Jul 1, 2020
Data Management automation moved this from Reviewer approved to Done Jul 1, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/feature Issues related to feature request from users
Projects
No open projects
Development

Successfully merging this pull request may close these issues.

Snapshot Integration and Enhancement
4 participants