Skip to content

Conversation

tobixdev
Copy link
Owner

The first draft for supporting object id encoding #25

Copy link

codspeed-hq bot commented Jul 24, 2025

CodSpeed Performance Report

Merging #27 will degrade performances by 58.21%

Comparing feature/25-object-encoding (4561813) with main (72199b8)

Summary

⚡ 17 improvements
❌ 8 regressions
✅ 10 untouched benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Benchmarks breakdown

Benchmark BASE HEAD Change
BSBM Business Intelligence 1000 - Query 1 124.8 ms 35.7 ms ×3.5
BSBM Business Intelligence 1000 - Query 2 561.7 ms 1,344.1 ms -58.21%
BSBM Business Intelligence 1000 - Query 3 270.6 ms 208.4 ms +29.84%
BSBM Business Intelligence 1000 - Query 4 469.1 ms 142 ms ×3.3
BSBM Business Intelligence 1000 - Query 5 197.3 ms 74.8 ms ×2.6
BSBM Business Intelligence 1000 - Query 6 604 ms 481.2 ms +25.52%
BSBM Business Intelligence 1000 - Query 7 217 ms 127.8 ms +69.83%
BSBM Business Intelligence 1000 - Query 8 395.3 ms 165.4 ms ×2.4
BSBM Explore 1000 - Query 10 220.1 ms 55.1 ms ×4
BSBM Explore 1000 - Query 11 3.3 ms 3.7 ms -11.44%
BSBM Explore 1000 - Query 12 28.1 ms 16.3 ms +71.85%
BSBM Explore 1000 - Query 1 27.7 ms 20.8 ms +32.98%
BSBM Explore 1000 - Query 2 35.7 ms 23.9 ms +49.29%
BSBM Explore 1000 - Query 3 48 ms 33.8 ms +42%
BSBM Explore 1000 - Query 4 54.2 ms 36 ms +50.58%
BSBM Explore 1000 - Query 5 105.9 ms 70.4 ms +50.38%
BSBM Explore 1000 - Query 7 276.9 ms 97.1 ms ×2.9
BSBM Explore 1000 - Query 8 240.8 ms 143.1 ms +68.26%
BSBM Explore 1000 - Query 9 34.8 ms 9.2 ms ×3.8
query - Single Pattern / 8192 Quads 24.5 ms 32.2 ms -23.96%
... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

@tobixdev
Copy link
Owner Author

We should investigate the three "BSBM Business Intelligence 1000" regressions. It seems like the query planner has some problem. Otherwise, the regressions are fine as we will have an overhead in the microbenchmarks that immediately decodes the record batch. Maybe the BSBM Explore query could be investigated too.

@tobixdev
Copy link
Owner Author

I'll merge the PR for now, as most benchmarks exhibit a substantial speedup and the microbenchmarks won't become faster as we cannot amortize the object ID decoding overhead. I'll create a follow-up issue for "BSBM Business Intelligence 1000 - Query 2".

@tobixdev tobixdev merged commit 942da7a into main Jul 25, 2025
2 of 3 checks passed
@tobixdev tobixdev deleted the feature/25-object-encoding branch September 16, 2025 14:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant