Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add pgvector client sqlalchemy #10

Merged
merged 35 commits into from
Sep 12, 2023
Merged

Add pgvector client sqlalchemy #10

merged 35 commits into from
Sep 12, 2023

Conversation

ioanarm
Copy link
Contributor

@ioanarm ioanarm commented Sep 12, 2023 •
edited by yoziru

Resolves #4
Adds pgvector support with sqlalchemy

Adds: Create, Delete, Get, List functionality for collections in the DB.
Adds: Insert/Update, Delete, Get and Query based on cosine similarity functionality for collection points in the DB

@ioanarm ioanarm force-pushed the add-pgvector-client-sqlalchemy branch from 75166ca to db13ca7 Compare September 12, 2023 12:21
@ioanarm ioanarm marked this pull request as ready for review September 12, 2023 14:26
yoziru
yoziru approved these changes Sep 12, 2023
View reviewed changes
Copy link
Collaborator

@yoziru yoziru left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's get this in, it's a good base we can build on top

@yoziru yoziru mentioned this pull request Sep 12, 2023
Closed
ioanarm and others added 26 commits September 12, 2023 17:58
@ioanarm
Add docker compose and pgvector dependency
7f88bf9
@ioanarm
wip: Add pgvector client
ef6c8f6
@ioanarm
wip: create/delete collection basic functionality
fea68c1
@ioanarm
enable delete with MetaData
4534018
@ioanarm
Add sync with db
180d7dd
@ioanarm
Add sync and list_collections in pgclient
c0cf6b7
@ioanarm
add sync in delete
02e1353
@ioanarm
remove table from MetaData
f32841c
@ioanarm
upsert point in table - collections_dict
873cced
@ioanarm
wip: basic working version with upsert and query - Models needs refac…
0ad9316 
…toring
@yoziru @ioanarm
client model: add setup/teardown methods
b36efc0 
+ integrate into app lifespan events
@yoziru @ioanarm
pgvector: support setup method on app startup
1a064e1
@yoziru @ioanarm
setup: bring back sync
cdcca31
@yoziru @ioanarm
docker compose: add VECTORDB_CLIENT env
c62bc88
@yoziru @ioanarm
sqlalchemy: define asyncio extras
a1cb61f
@yoziru @ioanarm
stash 1
b7edf8e
@yoziru @ioanarm
stash2
f68896e
@yoziru @ioanarm
more stashes
75d7853
@yoziru @ioanarm
db: register vector type codec
cddeea0
@yoziru @ioanarm
stash
17c40fa
@yoziru @ioanarm
fix vector dimension
708935e
@yoziru @ioanarm
base query support
a03977e
@yoziru @ioanarm
get vector dimension from table metadata
ca18721
@ioanarm
return score with query result
b502d4a
@ioanarm
delete collection
564dc73
@ioanarm
Add get_collection logic
a707bcc
@ioanarm ioanarm force-pushed the add-pgvector-client-sqlalchemy branch from 04972ab to eea1417 Compare September 12, 2023 14:59
@ioanarm ioanarm merged commit 761e386 into main Sep 12, 2023
2 checks passed
@ioanarm ioanarm deleted the add-pgvector-client-sqlalchemy branch September 12, 2023 15:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@yoziru yoziru yoziru approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Add pgvector support
2 participants
@ioanarm @yoziru