Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

If there are multi segments, the result of IVF_PQ IP is wrong #2952

Closed
shengjun1985 opened this issue Jul 21, 2020 · 3 comments · Fixed by #2955
Closed

If there are multi segments, the result of IVF_PQ IP is wrong #2952

shengjun1985 opened this issue Jul 21, 2020 · 3 comments · Fixed by #2955
Assignees
Labels
kind/bug Issues or changes related a bug

Comments

@shengjun1985
Copy link
Contributor

Please state you issue using the following template and, most importantly, in English.

Describe the bug
If there are multi segments, the result of IVF_PQ IP is wrong.
There is a bug in merging task result.

Steps/Code to reproduce behavior
(0) create collection whose metric_type is IP
(1) inset data and product multi segments
(2) create IVF_PQ
(3) query the topK nearest items
The result is wrong.

Expected behavior
The result is correct.

Environment details

  • Milvus version (v0.10.1)

Screenshots
none

Additional context
from source review

@dvzubarev
Copy link
Contributor

What is "multi segments" ? I searched this repository and found nothing except this issue and PRs.

@shengjun1985
Copy link
Contributor Author

When the total data in a collection is large enough, ie. multiple gigabytes, Milvus will organize the data in multiple slices, or "segments". For instance, 1 GB of vector data per segment. Then, Milvus will build index for each of the data segment.

Thus, if you have a collection containing 10 GB of vector data, and 1GB per segment, we will have 10 segments.
That is where the "multi-segments" come from.

@dvzubarev
Copy link
Contributor

Thank you, for explanation

@mergify mergify bot closed this as completed in #2955 Jul 22, 2020
@shengjun1985 shengjun1985 added the kind/bug Issues or changes related a bug label Sep 3, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Issues or changes related a bug
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants