Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Smaller memory-consumption for JSON arrays of numbers. (To improve vector search) #3849

Open
javiabellan opened this issue Sep 11, 2023 · 1 comment
Assignees

Comments

@javiabellan
Copy link

javiabellan commented Sep 11, 2023

Issue originally posted in RedisJSON: RedisJSON/RedisJSON#1087

Regarding this issue, i think the best the RediSearch can do for vector search is:

  1. Allow having multiple vectors in the same byte array hash field. Because at indexing time we will know the vector dimension and its numeric representation (currently fp32 or fp64); therefore the number of vectors in the byte array can be calculated. This idea is inspired from indexing json array of N vectors
  2. (less important): Allow fp16, or even uint8 vector represenations. (like FAISS and USearch do)
Copy link

This issue is stale because it has been open for 60 days with no activity.

@github-actions github-actions bot added the stale label Nov 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants