Skip to content

Demo TurboQuant basic search with serialization#7451

Open
connortsui20 wants to merge 1 commit intodevelopfrom
ct/tq-example
Open

Demo TurboQuant basic search with serialization#7451
connortsui20 wants to merge 1 commit intodevelopfrom
ct/tq-example

Conversation

@connortsui20
Copy link
Copy Markdown
Contributor

@connortsui20 connortsui20 commented Apr 15, 2026

Summary

Tracking issue: #7297

Adds a TurboQuant demo where we convert the parquet files to a Vortex file (in-memory only now, but still serialized as bytes), and then we verify by decoding and performing a basic cosine similarity expression search with a filter pushdown.

Testing

The example runs!

@connortsui20 connortsui20 added the changelog/feature A new feature label Apr 15, 2026
@connortsui20 connortsui20 marked this pull request as draft April 15, 2026 18:14
@connortsui20 connortsui20 changed the title Demo tq basic search with serialization Demo TurboQuant basic search with serialization Apr 15, 2026
@connortsui20 connortsui20 marked this pull request as ready for review April 15, 2026 18:17
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq bot commented Apr 15, 2026

Merging this PR will not alter performance

✅ 1153 untouched benchmarks
🆕 10 new benchmarks
⏩ 1455 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
🆕 Simulation turboquant_compress_dim1024_2bit N/A 47.5 ms N/A
🆕 Simulation turboquant_compress_dim1024_4bit N/A 52.6 ms N/A
🆕 Simulation turboquant_compress_dim1024_8bit N/A 62.8 ms N/A
🆕 Simulation turboquant_decompress_dim768_4bit N/A 42.2 ms N/A
🆕 Simulation turboquant_compress_dim128_4bit N/A 6.6 ms N/A
🆕 Simulation turboquant_decompress_dim1024_4bit N/A 43.9 ms N/A
🆕 Simulation turboquant_decompress_dim1024_2bit N/A 43.9 ms N/A
🆕 Simulation turboquant_compress_dim768_4bit N/A 52.1 ms N/A
🆕 Simulation turboquant_decompress_dim128_4bit N/A 5.5 ms N/A
🆕 Simulation turboquant_decompress_dim1024_8bit N/A 43.9 ms N/A

Comparing ct/tq-example (7b9846c) with develop (3188e24)

Open in CodSpeed

Footnotes

  1. 1455 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

Base automatically changed from ct/vector-datasets to develop April 15, 2026 18:23
@connortsui20 connortsui20 force-pushed the ct/tq-example branch 3 times, most recently from ec1f87c to e8e651c Compare April 15, 2026 19:08
@connortsui20 connortsui20 enabled auto-merge (squash) April 15, 2026 19:43
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant