Scalar merge master #2973

fishpenguin · 2020-07-22T13:44:13Z

What type of PR is this?

API-change / BUG / Improvement / Documentation / Feature

Which branch you want to cherry-pick to?

Not Available

Which issue(s) this PR fixes:

Fixes #

What this PR does / why we need it:

Not Available

Special notes for your reviewer:

Not Available

Additional documentation (e.g. design docs, usage docs, etc.):

Not Available

Signed-off-by: cmli <chengming.li@zilliz.com> Co-authored-by: cmli <chengming.li@zilliz.com>

* code opt Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * add some APIs for SSDBImpl Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* Remove body parser in show partitions endpoints (fix milvus-io#2690) Signed-off-by: yhz <413554850@qq.com> * Remove surplus output and comments Signed-off-by: yhz <413554850@qq.com> * Remove surplus output and comments Signed-off-by: yhz <413554850@qq.com> * Remove space line Signed-off-by: yhz <413554850@qq.com> * Remove surplus ut Signed-off-by: yhz <413554850@qq.com> * laten sleep time in case test_delete_vector_collection_count_no_flush Signed-off-by: yhz <413554850@qq.com>

* Offset for IVFFlat Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * modify segment reader Signed-off-by: shengjun.li <shengjun.li@zilliz.com> * add index_flat_nm Signed-off-by: shengjun.li <shengjun.li@zilliz.com> * fix compilation issue Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * fix segment reader Signed-off-by: shengjun.li <shengjun.li@zilliz.com> * Fix issue Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * fix hnsw_nm Signed-off-by: shengjun.li <shengjun.li@zilliz.com> * fix nsg Signed-off-by: shengjun.li <shengjun.li@zilliz.com> * fix bug Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * NSG Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * Fix NSG issue Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * client test Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * fix index size Signed-off-by: shengjun.li <shengjun.li@zilliz.com> * remove unnecessary things Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * add changelog Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * Fix clang format Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * add changelog Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * Fix compile error Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * Fix compile error Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * Fix compile error Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * Fix compile error Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * Fix issues Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * Change data to shared_ptr Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * fix hnsw and nsg ut Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * clang-format Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * not to insert cache immediately Signed-off-by: shengjun.li <shengjun.li@zilliz.com> * Fix macro issue Signed-off-by: sahuang <xiaohai.xu@zilliz.com> Co-authored-by: shengjun.li <shengjun.li@zilliz.com>

* (db/snapshot): integrate stage 1 Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): integrate stage 2 Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): integrate stage 3 Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): fix ut Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): integrate stage 4 Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): integrate stage 5 Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): integrate stage 6 Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): integrate stage 7 Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): add params for some resources Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): add field type Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): implement iterate framework for Snapshot Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): refactor code Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): fix lint errors Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): add SnapshotHandlers Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): add SnapshotVistor Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): add SizeField for all resource commit Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): add SegmentsToSearch collector Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): Iterate handler update Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): Update IterateHandler Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): Add some hooks for IterateHandler Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): Small code refactor Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): Add const for some snapshot APIs Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): Add const for some snapshots APIs Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): Update create collection Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): merge to new ssdb Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): fix lint errors Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): add test_db in ssdb Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): update test_ssdb Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): add PartitionTest Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): add DropIndexOperation Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): Add IndexTest Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): Fix some bugs Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): add RowCount for some resources Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): code refactor Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): fix compile error Signed-off-by: peng.xu <peng.xu@zilliz.com>

* Add pipeline step to print/get the container logs Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com> * Add pipeline step to print/get the container logs Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

Signed-off-by: shengjun.li <shengjun.li@zilliz.com> Co-authored-by: groot <yhmo@zeronedata.com>

* (db/snapshot): add drop all index operation Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): Add ut for drop all index operation Signed-off-by: peng.xu <peng.xu@zilliz.com>

Signed-off-by: groot <yihua.mo@zilliz.com>

* Increase GRPC concurrency Signed-off-by: JinHai-CN <hai.jin@zilliz.com> * Fix lint Signed-off-by: JinHai-CN <hai.jin@zilliz.com> * Add limitation Signed-off-by: JinHai-CN <hai.jin@zilliz.com> * Fix compilation error Signed-off-by: JinHai-CN <hai.jin@zilliz.com> * Fix compilation error Signed-off-by: JinHai-CN <hai.jin@zilliz.com> * Fix compilation error Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Change Milvus Helm Version to v0.10.1 Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com> * [skip ci] update nightly cron Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Change Milvus Helm Version to v0.10.1 Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com> * [skip ci] update nightly cron Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com> * [skip ci] update nightly cron Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com> * changelog Signed-off-by: yhmo <yihua.mo@zilliz.com> * changelog Signed-off-by: yhmo <yihua.mo@zilliz.com> * typo Signed-off-by: yhmo <yihua.mo@zilliz.com>

* update cron on 0.10.1 Signed-off-by: zw <zw@milvus.io> * enable ivf_pq <ip> search cases on GPU Signed-off-by: zw <zw@milvus.io> Co-authored-by: zw <zw@milvus.io>

Signed-off-by: yhmo <yihua.mo@zilliz.com> * changelog Signed-off-by: yhmo <yihua.mo@zilliz.com> * changelog Signed-off-by: yhmo <yihua.mo@zilliz.com> * typo Signed-off-by: yhmo <yihua.mo@zilliz.com> * milvus-io#2692 Milvus hangs during multi-thread concurrent search Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* (db/snapshot): fix bugs and update UT Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): update Snapshot ToString Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): add DropIndex API Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): Add DropIndex API UT Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add more APIs for Snapshot Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): Refactor field element related code Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): fix lint error Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): remove some prints Signed-off-by: peng.xu <peng.xu@zilliz.com>

* add background threads to SSDBImpl Signed-off-by: yhmo <yihua.mo@zilliz.com> * code format Signed-off-by: yhmo <yihua.mo@zilliz.com>

* code opt Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * add some APIs for SSDBImpl Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * partially add GetVectorById Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * snapshot opt Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * fix typo Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * update GetVectorByID framework Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * rename GetResFiles to GetResPath Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * update GetVectorByIdSegmentHandler Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * add GetEntityByID Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * update DataType Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * update ParamField Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Snyk has created this PR to upgrade com.alibaba:fastjson from 1.2.70 to 1.2.71. See this package in NPM: https://www.npmjs.com/package/com.alibaba:fastjson See this project in Snyk: https://app.snyk.io/org/cxie/project/2f701ce6-b421-4bbf-aaad-9d2bdb8569e4?utm_source=github&utm_medium=upgrade-pr

* (db/snapshot): refactor Operations Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): refactor Operations Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): Add rollback for operations Signed-off-by: peng.xu <peng.xu@zilliz.com>

* code opt Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * add some APIs for SSDBImpl Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * partially add GetVectorById Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * snapshot opt Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * fix typo Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * update GetVectorByID framework Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * rename GetResFiles to GetResPath Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * update GetVectorByIdSegmentHandler Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * add GetEntityByID Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * update DataType Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * update ParamField Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * update GetEntityByIDSegmentHandler Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * support INT8 and INT16 in GetEntityById Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * add GetIDsInSegment Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * update FieldType Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * add InsertEntities and DeleteEntities Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * add HybridQuery Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* (db/snapshot): add Segment related visitors Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): fix lint error Signed-off-by: peng.xu <peng.xu@zilliz.com>

Signed-off-by: jinhai <hai.jin@zilliz.com>

* update HybridQuery Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * add IterateHandler Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * IterateHandler opt Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * opt Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * opt Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update cron on 0.10.1 Signed-off-by: zw <zw@milvus.io> * enable ivf_pq <ip> search cases on GPU Signed-off-by: zw <zw@milvus.io> * [skip ci] debug Signed-off-by: zw <zw@milvus.io> * [skip ci] add artifacts Signed-off-by: zw <zw@milvus.io> * update shards ci && enable pq case Signed-off-by: zw <zw@milvus.io> * update assertion for pq Signed-off-by: zw <zw@milvus.io> * disable rnsg: issue milvus-io#2813 Signed-off-by: zw <zw@milvus.io> * add binary version in log file name Signed-off-by: zw <zw@milvus.io> * enable rnsg case Signed-off-by: zw <zw@milvus.io> * [skip ci] Update config cases for the resources changed Signed-off-by: zw <zw@milvus.io> * [skip ci] Fix limit Signed-off-by: zw <zw@milvus.io> Co-authored-by: zw <zw@milvus.io>

* refine code Signed-off-by: yhmo <yihua.mo@zilliz.com> * typo Signed-off-by: yhmo <yihua.mo@zilliz.com> * excution engine Signed-off-by: yhmo <yihua.mo@zilliz.com>

…vus-io#2926) * (db/snapshot): update for row count Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): fix bug in NewSegmentOperation Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): remove dummy print Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): Add some test for row count Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): update size logic Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): update size logic related ut Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): rollback if operation is not done Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): clean store Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): remove some dependency Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): update for store Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): update Store.h Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): update store related code Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): add field element modification operation Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): change new operation name Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): fix lint error Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): Add Segment File Operation Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): crtp for BaseResource Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): add InActiveResourcesGCEvent Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): fix ut error Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): small change Signed-off-by: peng.xu <peng.xu@zilliz.com>

* Add root path for snapshot GC Signed-off-by: yhz <413554850@qq.com> * Add subfolder db in root path Signed-off-by: yhz <413554850@qq.com>

* fix update index size Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * add GetSize() interface 4 SPTAG Signed-off-by: cmli <chengming.li@zilliz.com> * fix index size of index hnsw, annoy and nsg Signed-off-by: cmli <chengming.li@zilliz.com> * fix clang Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * add sdk 4 non-ivf index test Signed-off-by: cmli <chengming.li@zilliz.com> * remove std::cout and make clang-format Signed-off-by: cmli <chengming.li@zilliz.com> * fix cout Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * checkout sdk Signed-off-by: cmli <chengming.li@zilliz.com> * fix binary ivf Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * fix hnsw Signed-off-by: shengjun.li <shengjun.li@zilliz.com> Co-authored-by: cmli <chengming.li@zilliz.com> Co-authored-by: shengjun.li <shengjun.li@zilliz.com>

* using BlockingQueue in JobMgr Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * update changelog Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * update SSDBImpl::HybridQuery Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * add QueryTest Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * add SearchJob interface Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * add SSSearchJob and SSSearchTask Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * update AddSegmentVisitor Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * add SSBuildIndexTask and SSBuildIndexJob Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * add SSTestTask Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * add test_ss_job and test_ss_task Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * fix clang-format Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * update TaskCreator Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix NM index size Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * add raw data size of hnsw_nm and nsg_nm Signed-off-by: cmli <chengming.li@zilliz.com> Co-authored-by: cmli <chengming.li@zilliz.com>

Signed-off-by: Amy Hong <yun.hong@zilliz.com>

Signed-off-by: Xiangyu Wang <xy.wang@zilliz.com>

* update interface Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * add test_ss_job Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * update Query Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * add dir_root for SSSearchJob and SSBuildIndexJob Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* (db/snapshot): update for row count Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): fix bug in NewSegmentOperation Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): remove dummy print Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): Add some test for row count Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): update size logic Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): update size logic related ut Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): rollback if operation is not done Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): clean store Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): remove some dependency Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): update for store Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): update Store.h Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): update store related code Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): add field element modification operation Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): change new operation name Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): fix lint error Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): Add Segment File Operation Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): crtp for BaseResource Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): add InActiveResourcesGCEvent Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): fix ut error Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): small change Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): update snapshot segmentcommit operation Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): update drop all index operation Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): update ut Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): fix lint error Signed-off-by: peng.xu <peng.xu@zilliz.com>

Signed-off-by: cmli <chengming.li@zilliz.com> Co-authored-by: cmli <chengming.li@zilliz.com>

* Add root path for snapshot GC Signed-off-by: yhz <413554850@qq.com> * Change Fun name from GetResPath to GetRootPath Signed-off-by: yhz <413554850@qq.com>

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add API to Get inactivate res in Store Signed-off-by: yhz <413554850@qq.com> * Update select logic in MetaAdapter Signed-off-by: yhz <413554850@qq.com> * Add event test case Signed-off-by: yhz <413554850@qq.com> * Add deactive collection test in SSEventTest.TestInActiveResGcEvent Signed-off-by: yhz <413554850@qq.com> * Add CollectinCommit in event test Signed-off-by: yhz <413554850@qq.com> * Add more res in event test Signed-off-by: yhz <413554850@qq.com> * Set url to mock in ssdb test Signed-off-by: yhz <413554850@qq.com>

* refine code Signed-off-by: yhmo <yihua.mo@zilliz.com> * refine Signed-off-by: yhmo <yihua.mo@zilliz.com> * ui error Signed-off-by: yhmo <yihua.mo@zilliz.com> * typo Signed-off-by: yhmo <yihua.mo@zilliz.com> * build index Signed-off-by: yhmo <yihua.mo@zilliz.com> * add utils Signed-off-by: yhmo <yihua.mo@zilliz.com> * build index Signed-off-by: yhmo <yihua.mo@zilliz.com> * build index Signed-off-by: yhmo <yihua.mo@zilliz.com> * execution engine Signed-off-by: yhmo <yihua.mo@zilliz.com> * typo Signed-off-by: yhmo <yihua.mo@zilliz.com> * typo Signed-off-by: yhmo <yihua.mo@zilliz.com> * build error Signed-off-by: yhmo <yihua.mo@zilliz.com>

* add option -s in build.sh for cuda arch Signed-off-by: yangxuan <xuan.yang@zilliz.com> * modify changelog Signed-off-by: yangxuan <xuan.yang@zilliz.com> * modify ci configs about cuda arch Signed-off-by: yangxuan <xuan.yang@zilliz.com> * fix bug Signed-off-by: yangxuan <xuan.yang@zilliz.com> * modify ci configs about cuda arch in jenkins ci Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com> * fix bug Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com> * fix bug Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com> * modify changelog Signed-off-by: yangxuan <xuan.yang@zilliz.com> * fix bug Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com> * fix bug Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com> * fix bugs Signed-off-by: yangxuan <xuan.yang@zilliz.com> * fix cmake cannot recognize space bug Signed-off-by: yangxuan <xuan.yang@zilliz.com> * fix conflict Signed-off-by: yangxuan <xuan.yang@zilliz.com> Co-authored-by: yangxuan <xuan.yang@zilliz.com> Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

codecov · 2020-07-23T03:38:11Z

Codecov Report

Merging #2973 into scalar-field-filtering will decrease coverage by 4.44%.
The diff coverage is 60.33%.

@@                    Coverage Diff                     @@
##           scalar-field-filtering    #2973      +/-   ##
==========================================================
- Coverage                   88.20%   83.76%   -4.45%     
==========================================================
  Files                         461      550      +89     
  Lines                       29295    34863    +5568     
==========================================================
+ Hits                        25840    29203    +3363     
- Misses                       3455     5660    +2205

Impacted Files	Coverage Δ
core/src/codecs/default/DefaultAttrsFormat.cpp	`61.29% <ø> (-0.57%)`	⬇️
core/src/codecs/default/DefaultAttrsFormat.h	`100.00% <ø> (ø)`
...ore/src/codecs/default/DefaultAttrsIndexFormat.cpp	`17.04% <ø> (-1.85%)`	⬇️
core/src/codecs/default/DefaultAttrsIndexFormat.h	`100.00% <ø> (ø)`
core/src/codecs/default/DefaultCodec.h	`100.00% <ø> (ø)`
...re/src/codecs/default/DefaultDeletedDocsFormat.cpp	`49.39% <ø> (-1.77%)`	⬇️
core/src/codecs/default/DefaultDeletedDocsFormat.h	`100.00% <ø> (ø)`
.../src/codecs/default/DefaultIdBloomFilterFormat.cpp	`76.92% <ø> (-1.65%)`	⬇️
...re/src/codecs/default/DefaultIdBloomFilterFormat.h	`100.00% <ø> (ø)`
...src/codecs/default/DefaultVectorCompressFormat.cpp	`0.00% <0.00%> (ø)`
... and 354 more

op-hunter and others added 30 commits July 2, 2020 17:33

fix a typo (milvus-io#2712)

a5f6a77

Signed-off-by: cmli <chengming.li@zilliz.com> Co-authored-by: cmli <chengming.li@zilliz.com>

snapshot integration (milvus-io#2716)

f7c1d0a

* code opt Signed-off-by: yudong.cai <yudong.cai@zilliz.com> * add some APIs for SSDBImpl Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Add pipeline step to print/get the container logs (milvus-io#2730)

e892626

* Add pipeline step to print/get the container logs Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com> * Add pipeline step to print/get the container logs Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

Create index failed caused by server crashed (milvus-io#2736)

0672347

Signed-off-by: shengjun.li <shengjun.li@zilliz.com> Co-authored-by: groot <yhmo@zeronedata.com>

(db/snapshot): Add DropAllIndexOperation and related UT (milvus-io#2737)

3b89842

* (db/snapshot): add drop all index operation Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): Add ut for drop all index operation Signed-off-by: peng.xu <peng.xu@zilliz.com>

search combine configable

5015557

Signed-off-by: groot <yihua.mo@zilliz.com>

typo

3cbb5ce

Signed-off-by: groot <yihua.mo@zilliz.com>

Change Milvus Helm Version to v0.10.1 (milvus-io#2678)

bffa1d7

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

[skip ci] update nightly cron (milvus-io#2680)

32d77d3

* Change Milvus Helm Version to v0.10.1 Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com> * [skip ci] update nightly cron Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* milvus-io#2642 Create index failed caused by server crashed.

045089e

Signed-off-by: yhmo <yihua.mo@zilliz.com> * changelog Signed-off-by: yhmo <yihua.mo@zilliz.com> * changelog Signed-off-by: yhmo <yihua.mo@zilliz.com> * typo Signed-off-by: yhmo <yihua.mo@zilliz.com>

enable ivf_pq <ip> search cases on GPU (milvus-io#2708)

04eb5a8

* update cron on 0.10.1 Signed-off-by: zw <zw@milvus.io> * enable ivf_pq <ip> search cases on GPU Signed-off-by: zw <zw@milvus.io> Co-authored-by: zw <zw@milvus.io>

Fix compiling error

62e437d

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

[skip ci] Update PR template

004c201

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

Let codec singleton (milvus-io#2742)

36cb247

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

add background threads to SSDBImpl (milvus-io#2751)

43496d5

* add background threads to SSDBImpl Signed-off-by: yhmo <yihua.mo@zilliz.com> * code format Signed-off-by: yhmo <yihua.mo@zilliz.com>

(db/snapshot): Add some helper visitors (milvus-io#2777)

af573f9

* (db/snapshot): add Segment related visitors Signed-off-by: peng.xu <peng.xu@zilliz.com> * (db/snapshot): fix lint error Signed-off-by: peng.xu <peng.xu@zilliz.com>

Update template

71d3653

Signed-off-by: jinhai <hai.jin@zilliz.com>

del-zhenwu and others added 17 commits July 20, 2020 17:50

refine code (milvus-io#2927)

dc93524

* refine code Signed-off-by: yhmo <yihua.mo@zilliz.com> * typo Signed-off-by: yhmo <yihua.mo@zilliz.com> * excution engine Signed-off-by: yhmo <yihua.mo@zilliz.com>

(db/snapshot) Add root path for snapshot GC (milvus-io#2936)

2bfc108

* Add root path for snapshot GC Signed-off-by: yhz <413554850@qq.com> * Add subfolder db in root path Signed-off-by: yhz <413554850@qq.com>

milvus-io#2890 Fix wrong index size (milvus-io#2942)

d85b3f9

* fix NM index size Signed-off-by: sahuang <xiaohai.xu@zilliz.com> * add raw data size of hnsw_nm and nsg_nm Signed-off-by: cmli <chengming.li@zilliz.com> Co-authored-by: cmli <chengming.li@zilliz.com>

Minor editorial updates. (milvus-io#2946)

097635e

Signed-off-by: Amy Hong <yun.hong@zilliz.com>

fix cuda version requirement (milvus-io#2909)

21ea715

Signed-off-by: Xiangyu Wang <xy.wang@zilliz.com>

fix a bug of annoy search parameter exisitence check (milvus-io#2958)

0e0a731

Signed-off-by: cmli <chengming.li@zilliz.com> Co-authored-by: cmli <chengming.li@zilliz.com>

(db/snapshot) Add root path for snapshot store (milvus-io#2945)

d4f305a

* Add root path for snapshot GC Signed-off-by: yhz <413554850@qq.com> * Change Fun name from GetResPath to GetRootPath Signed-off-by: yhz <413554850@qq.com>

Fix the result merging of IVF_PQ IP (milvus-io#2955)

b548b38

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Fix conflicts

5db5450

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Fix C++ sdk DataType

677dbb1

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Fix collection test cases bugs

3f1b567

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

fishpenguin requested review from JinHai-CN, wxyucs, shengjun1985 and yhmo as code owners July 22, 2020 13:44

BossZou and others added 6 commits July 22, 2020 13:55

Fix test_rpc bugs

9b30a88

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Fix conflicts

d3e120e

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Fix test_rpc

2f95ef6

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

fishpenguin merged commit 1b9d732 into milvus-io:scalar-field-filtering Jul 25, 2020

fishpenguin deleted the scalar_merge_master branch April 21, 2021 09:28

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Scalar merge master #2973

Scalar merge master #2973

fishpenguin commented Jul 22, 2020

codecov bot commented Jul 23, 2020 •

edited

Loading

Scalar merge master #2973

Scalar merge master #2973

Conversation

fishpenguin commented Jul 22, 2020

codecov bot commented Jul 23, 2020 • edited Loading

Codecov Report

codecov bot commented Jul 23, 2020 •

edited

Loading