Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add filtering to vector search tutorial #1996

Merged
merged 2 commits into from
Dec 1, 2023

Conversation

lowener
Copy link
Contributor

@lowener lowener commented Nov 15, 2023

No description provided.

@lowener lowener added 3 - Ready for Review doc Documentation non-breaking Non-breaking change labels Nov 15, 2023
### Filtering

As of RAFT 23.10, support for pre-filtering of neighbors has been added to ANN index. This feature is useful for applications that want to remove vectors already added to the index, or to enable access control in searches. The filtering is done by applying a predicate function on the GPU. The following example demonstrates how to use the filtering API:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you add some more information to this description? Think about it like walking the user through the use-case like they are reading a book on the topic. THings such as:

  1. Moreso than just removing vectors already added to the index, what types of use-cases does this enable? (e.g. hybrid search, multi-valued keys, deletion, security label filtering, etc...
  2. What types of functions are available and why?
  3. What's a bitset and why would one use that primitive?

A section like this is where it's really important that we spell out the capabilities and potential here.

@lowener lowener changed the base branch from branch-23.12 to branch-24.02 November 29, 2023 16:42
@cjnolet
Copy link
Member

cjnolet commented Dec 1, 2023

/merge

@rapids-bot rapids-bot bot merged commit b8c026b into rapidsai:branch-24.02 Dec 1, 2023
61 checks passed
@lowener lowener deleted the 23.12-doc-filtering branch December 1, 2023 15:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3 - Ready for Review doc Documentation non-breaking Non-breaking change
Projects
Development

Successfully merging this pull request may close these issues.

None yet

2 participants