Skip to content

feat: add support for PolarDB#737

Open
nanlongyu wants to merge 1 commit intozilliztech:mainfrom
nanlongyu:main
Open

feat: add support for PolarDB#737
nanlongyu wants to merge 1 commit intozilliztech:mainfrom
nanlongyu:main

Conversation

@nanlongyu
Copy link

Description

This PR introduces support for PolarDB, an Alibaba Cloud cloud-native relational database service, as a new database engine in VectorDBBench. PolarDB features IMCI (In-Memory Column Index) based vector search capabilities, leveraging FAISS as its underlying vector engine. It is compatible with the MySQL protocol, offering high-performance and cost-effective vector retrieval on top of a fully-managed cloud-native architecture with features like storage-compute separation, read-write splitting, and elastic scaling — making it well-suited for enterprise-level AI and similarity search scenarios.

Supported Index Types:

  • HNSW:High-performance graph-based indexing with full-precision vectors, providing the best recall quality.
  • HNSWPQ:Combines HNSW graph navigation with Product Quantization for memory-efficient retrieval at scale.
  • HNSWSQ:Combines HNSW graph navigation with Scalar Quantization, balancing speed, memory usage, and recall.

- add PolarDB vector search client with FAISS_HNSW_FLAT, FAISS_HNSW_PQ, and FAISS_HNSW_SQ index types
- add CLI integration with hnswflat, hnswpq, and hnswsq benchmark commands
- add frontend (Streamlit) UI support with index type selection, HNSW/PQ/SQ parameter configuration
@sre-ci-robot
Copy link

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: nanlongyu
To complete the pull request process, please assign xuanyang-cn after the PR has been reviewed.
You can assign the PR to them by writing /assign @xuanyang-cn in a comment when ready.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@nanlongyu
Copy link
Author

/assign @XuanYang-cn

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants