Skip to content

Add HyperLogLog benchmarks: PFCOUNT and PFMERGE #313

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Oct 12, 2025
Merged

Add HyperLogLog benchmarks: PFCOUNT and PFMERGE #313

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
b2ef6a0
Add memtier benchmark for HyperLogLog PFCOUNT with multiple keys
paulorsousa Oct 11, 2025
e29f672
Add memtier benchmark for HyperLogLog PFMERGE
paulorsousa Oct 11, 2025
c370986
Reduce test time for memtier benchmark in HyperLogLog PFCOUNT and PFM…
paulorsousa Oct 12, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
34 changes: 34 additions & 0 deletions ...nchmarks_specification/test-suites/memtier_benchmark-multiple-hll-pfcount-100B-values.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,34 @@
version: 0.4
name: memtier_benchmark-multiple-hll-pfcount-100B-values
description: Runs memtier_benchmark, pre-loading multiple HyperLogLog keys with 100B sized random elements using PFADD, then testing PFCOUNT performance by counting these pre-loaded HLLs.
dbconfig:
configuration-parameters:
save: '""'
check:
keyspacelen: 3
preload_tool:
run_image: redislabs/memtier_benchmark:edge
tool: memtier_benchmark
arguments: '"--data-size" "100" --random-data --command "PFADD __key__ __data__" --command-key-pattern="P" --key-minimum=1 --key-maximum 3 -n 30000 -c 1 -t 1 --hide-histogram'
resources:
requests:
memory: 2g
tested-groups:
- hyperloglog
tested-commands:
- pfcount
redis-topologies:
- oss-standalone
build-variants:
- gcc:15.2.0-amd64-debian-bookworm-default
- gcc:15.2.0-arm64-debian-bookworm-default
- dockerhub
clientconfig:
run_image: redislabs/memtier_benchmark:edge
tool: memtier_benchmark
arguments: --test-time 60 --command "PFCOUNT memtier-1 memtier-2 memtier-3" -c 50 -t 4 --hide-histogram
resources:
requests:
cpus: '4'
memory: 2g
priority: 62
34 changes: 34 additions & 0 deletions ...nchmarks_specification/test-suites/memtier_benchmark-multiple-hll-pfmerge-100B-values.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,34 @@
version: 0.4
name: memtier_benchmark-multiple-hll-pfmerge-100B-values
description: Runs memtier_benchmark, pre-loading multiple HyperLogLog keys with 100B sized random elements using PFADD, then testing PFMERGE performance by merging these pre-loaded HLLs.
dbconfig:
configuration-parameters:
save: '""'
check:
keyspacelen: 3
preload_tool:
run_image: redislabs/memtier_benchmark:edge
tool: memtier_benchmark
arguments: '"--data-size" "100" --random-data --command "PFADD __key__ __data__" --command-key-pattern="P" --key-minimum=1 --key-maximum 3 -n 30000 -c 1 -t 1 --hide-histogram'
resources:
requests:
memory: 2g
tested-groups:
- hyperloglog
tested-commands:
- pfmerge
redis-topologies:
- oss-standalone
build-variants:
- gcc:15.2.0-amd64-debian-bookworm-default
- gcc:15.2.0-arm64-debian-bookworm-default
- dockerhub
clientconfig:
run_image: redislabs/memtier_benchmark:edge
tool: memtier_benchmark
arguments: --test-time 60 --command "PFMERGE merged memtier-1 memtier-2 memtier-3" -c 50 -t 4 --hide-histogram
resources:
requests:
cpus: '4'
memory: 2g
priority: 62
Loading