Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support sqlite vector search module #157

Closed
bjsi opened this issue Nov 3, 2023 · 2 comments
Closed

Support sqlite vector search module #157

bjsi opened this issue Nov 3, 2023 · 2 comments
Labels
enhancement New feature or request

Comments

@bjsi
Copy link

bjsi commented Nov 3, 2023

There's a sqlite extension to support vector search called sqlite-vss. This would be a welcome addition to modelfusion because sqlite is like a stepping stone between the in-memory JSON vector DB and a "proper" vector DB like pinecone. The advantage it has over the in-memory JSON approach is that it doesn't take up a bunch of RAM, so I can deploy prototypes quickly for free without upgrading to paid tiers 😄. Also it's less setup than pinecone.

I would be glad to implement this myself because I'm already familiar with sqlite-vss if that sounds good to you.

@lgrammel
Copy link
Collaborator

lgrammel commented Nov 3, 2023

@bjsi awesome idea! there are some existing example (in-memory vector db, pinecone). Ideally this would be a separate extension, similar to extensions/pinecone. Let me know if you have any questions :)

@lgrammel lgrammel added the enhancement New feature or request label Nov 3, 2023
@bjsi
Copy link
Author

bjsi commented Nov 3, 2023

Great! I'll have a go and let you know if I run into any issues :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants