Skip to content

Update default Panorama batch size to 1024 - #5441

Closed
aknayar wants to merge 6 commits into
facebookresearch:mainfrom
aknayar:default-batch-size
Closed

Update default Panorama batch size to 1024#5441
aknayar wants to merge 6 commits into
facebookresearch:mainfrom
aknayar:default-batch-size

Conversation

@aknayar

@aknayar aknayar commented Jul 17, 2026

Copy link
Copy Markdown
Contributor

Changes

This PR unifies the default Panorama batch size to 1024 going forward. This was shown to offer better performance than the current values (paper, figure 11).

Performance

IVFFlatPanorama

SIFT1M

nprobe qps_before qps_after speedup
1 5980.4 6343.7 1.06x
2 3537.7 3933.2 1.11x
4 2105.4 2419.9 1.15x
8 1245.2 1466.4 1.18x
16 729.2 887.4 1.22x
32 429.6 538.0 1.25x
64 249.0 319.3 1.28x

GIST1M

nprobe qps_before qps_after speedup
1 1826.0 1494.7 0.82x
2 1091.0 1001.7 0.92x
4 642.2 639.0 0.99x
8 368.7 392.7 1.07x
16 212.2 233.9 1.10x
32 122.2 138.6 1.13x
64 71.3 82.6 1.16x

FlatL2Panorama

SIFT1M

qps_before qps_after speedup
124.8 133.4 1.07x

GIST1M

qps_before qps_after speedup
44.1 46.2 1.05x

@meta-cla meta-cla Bot added the CLA Signed label Jul 17, 2026
@aknayar

aknayar commented Jul 31, 2026

Copy link
Copy Markdown
Contributor Author

@mnorris11 Gentle bump :)

@meta-codesync

meta-codesync Bot commented Jul 31, 2026

Copy link
Copy Markdown
Contributor

@mnorris11 has imported this pull request. If you are a Meta employee, you can view this in D114387063.

@meta-codesync meta-codesync Bot closed this in 76c67b7 Aug 3, 2026
@meta-codesync meta-codesync Bot added the Merged label Aug 3, 2026
@meta-codesync

meta-codesync Bot commented Aug 3, 2026

Copy link
Copy Markdown
Contributor

@mnorris11 merged this pull request in 76c67b7.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants