Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature]: Support Partition Key Isolation #34332

Closed
3 tasks done
PwzXxm opened this issue Jul 2, 2024 · 4 comments
Closed
3 tasks done

[Feature]: Support Partition Key Isolation #34332

PwzXxm opened this issue Jul 2, 2024 · 4 comments
Assignees
@PwzXxm @xiaofan-luan
Labels
kind/feature Issues related to feature request from users

Comments

@PwzXxm
Copy link
Contributor

PwzXxm commented Jul 2, 2024 •
edited
Loading

Is there an existing issue for this?

  • I have searched the existing issues

Is your feature request related to a problem? Please describe.

Under the scenario of multi-tenant, sometimes it is meaningless to search across tenants, i.e., search for TopK nearest vectors while satisfying userID in [123, 456, 789]. It is sufficient to search with expressions userID == 123 or like userID==123 && location == 'Earth' to have some benefits listed below.

Describe the solution you'd like.

We could build/load/search part of the indices to

  • reduce build time
  • reduce load time
  • reduce memory usage
  • possibly reduce search latency

Describe an alternate solution.

No response

Anything else? (Additional Context)

This feature is built upon on Materialized View.

SDK changes:

  • Go
  • Restful

Others already support properties
@PwzXxm PwzXxm added the kind/feature Issues related to feature request from users label Jul 2, 2024
@PwzXxm
Copy link
Contributor Author

PwzXxm commented Jul 2, 2024

This is a ZillizCloud-only feature

@PwzXxm PwzXxm mentioned this issue Jul 2, 2024
Merged
@PwzXxm
Copy link
Contributor Author

PwzXxm commented Jul 2, 2024

/assign

This was referenced Jul 2, 2024
Merged
Closed
Merged
@PwzXxm
Copy link
Contributor Author

PwzXxm commented Jul 11, 2024

Needs to cherry pick to 2.4, wait for 2.4.6 release

sre-ci-robot pushed a commit that referenced this issue Jul 11, 2024
@PwzXxm
feat: support partition key isolation (#34336)
104d096 
issue: #34332

---------

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
PwzXxm added a commit to PwzXxm/milvus that referenced this issue Jul 11, 2024
@PwzXxm
feat: support partition key isolation (milvus-io#34336)
5721291 
issue: milvus-io#34332

---------

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
(cherry picked from commit 104d096)
@PwzXxm PwzXxm mentioned this issue Jul 11, 2024
Merged
chyezh pushed a commit to chyezh/milvus that referenced this issue Jul 15, 2024
@PwzXxm @chyezh
feat: support partition key isolation (milvus-io#34336)
c57c8f1 
issue: milvus-io#34332

---------

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
This was referenced Jul 16, 2024
Merged
Merged
sre-ci-robot pushed a commit to milvus-io/milvus-sdk-go that referenced this issue Jul 17, 2024
@PwzXxm
feat: add support for partition key isolation property (#787)
6f53a28 
issue: milvus-io/milvus#34332

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
sre-ci-robot pushed a commit that referenced this issue Jul 17, 2024
@PwzXxm
feat: [cherry-pick][2.4] support partition key isolation (#34336) (#3…
3cf2e18 
…4613)

issue: #34332
pr: #34336

---------

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
(cherry picked from commit 104d096)
@PwzXxm PwzXxm mentioned this issue Jul 22, 2024
Merged
sre-ci-robot pushed a commit that referenced this issue Jul 22, 2024
@PwzXxm
feat: [restful v2] add partition key isolation prop (#34710)
80c0ae3 
issue: #34332

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
sre-ci-robot pushed a commit that referenced this issue Jul 22, 2024
@PwzXxm
feat: [restful v2][2.4] add partition key isolation prop (#34869)
606bdd7 
issue: #34332
pr: #34710

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
(cherry picked from commit 703feaf)
@PwzXxm
Copy link
Contributor Author

PwzXxm commented Jul 22, 2024

All code including SDK has been merged.
Waiting for the test report.

@PwzXxm PwzXxm closed this as completed Sep 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@PwzXxm PwzXxm

@xiaofan-luan xiaofan-luan

Labels
kind/feature Issues related to feature request from users
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@PwzXxm @xiaofan-luan