⚡ Powered by FastEmbed: PolyVector brings In-Engine Hybrid Search to Postgres (3.2x faster than Elasticsearch) #11270
am-mar7
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Hey Qdrant community! 👋
Big shoutout to the Qdrant team for
fastembed! We recently used FastEmbed as the core local inference engine for PolyVector, an open-source in-engine hybrid search library for PostgreSQL.💡 What we built with FastEmbed:
By pairing FastEmbed CPU inference (
bge-small-en-v1.5) with PostgreSQL partial HNSW indexes and length-normalized BM25 (ts_rank_cd(32)), we were able to run hybrid search entirely inside Postgres without any external search cluster or third-party embedding API costs.📊 100,000-Document Benchmark vs. Elasticsearch 8.x:
FastEmbed made CPU-only local inference blazing fast and practical for high-throughput database workloads.
Check out the repo and full benchmark numbers here: https://github.com/am-mar7/polyvector
All reactions