Adding Postgres Support #145
Open
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This will address: #136
This pull request introduces PostgreSQL support with pgvector integration for vector similarity search, replacing the default retrieval endpoint and adding new configurations, scripts, and dependencies.
Key changes include updating configuration files, adding PostgreSQL-specific scripts, and modifying the retrieval logic to support the new database type.
PostgreSQL Integration
.env.template
for database configuration.config_retrieval.yaml
to set PostgreSQL as the preferred retrieval endpoint and added configuration details for thepostgres
endpoint.setup_postgres.sql
andsetup_postgres_schema.py
scripts for setting up and validating the PostgreSQL schema with pgvector.postgres_example.py
, to demonstrate PostgreSQL vector database integration.Retrieval Logic Updates
retriever.py
to include a new client,PgVectorClient
, for handling PostgreSQL-based retrieval.postgres_diagnostics.py
, to identify and resolve PostgreSQL configuration issues.test_postgres_connection.py
, to identify and resolve PostgreSQL configuration issues.Dependency Updates
psycopg2-binary
andpgvector
torequirements.txt
for PostgreSQL integration and vector operations.Future Opportunities:
Working demo.
https://www.loom.com/share/b7c14ff1f0b347a38f51b15ea5175701?sid=31410d68-1bb8-41aa-9e24-dc6f951396ca