Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update Faiss ANN to support IVF strings without number of cells #594

Closed
davidmezzetti opened this issue Nov 4, 2023 · 0 comments
Closed

Update Faiss ANN to support IVF strings without number of cells #594

davidmezzetti opened this issue Nov 4, 2023 · 0 comments
Assignees
@davidmezzetti
Milestone
v6.2.0

Comments

@davidmezzetti
Copy link
Member

Currently, a components string with Faiss requires specifying the number of IVF cells. This change will add logic to automatically calculate the number of IVF cells when the number of cells is omitted.

For example, take a notional example of 10,000 training records. With this change, the settings below will create the following indexes.

Components Index
Empty IVF256,Flat
IVF100,Flat IVF100,Flat
IVF,Flat IVF256,Flat
@davidmezzetti davidmezzetti added this to the v6.2.0 milestone Nov 4, 2023
@davidmezzetti davidmezzetti self-assigned this Nov 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@davidmezzetti davidmezzetti

Labels
None yet
Projects
None yet
Milestone
v6.2.0
Development

No branches or pull requests
1 participant
@davidmezzetti