Repository navigation
mlxVS 0.11.0
mlxVS 0.11.0: IvfPqIndex and refine.
pip install -U mlxvsIvfPqIndex(C++ivf_pq_build,ivf_pq_search,ivf_pq_extend), as cuVS's IVF-PQ: k-means lists, rows
stored aspq_dimcodes ofpq_bits(4 to 8) of their residual to the center, per-subspace codebooks, cuVS's
pq_dimheuristic (zero columns pad the dimension to a multiple ofpq_dim). Searches build a float32 lookup
table per (query, list) in chunks of subspaces and sum it over each row's codes. SIFT1M: 63 MB of codes for
505 MB of rows, built in 21.7 s; withrefine_ratio=4recall@10 0.954 at 18,300 queries/s (n_probes20) and
0.993 at 8,100 (50), as IVF-Flat's.refine(C++ and Python), as cuVS's: exact re-ranking of candidate ids. From Python the rows may be a NumPy
array ornumpy.memmap: only the candidates' rows are read, on the host.