Skip to content

Added 11 extra STRING benchmarks #93

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 8 commits into from
Apr 25, 2022
Merged

Added 11 extra STRING benchmarks #93

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
7c016f5
Removed test_commands.py given it's not ready yet
filipecosta90 Feb 16, 2022
a748579
Merge branch 'main' of github.com:redis/redis-benchmarks-specification
filipecosta90 Feb 18, 2022
0065af0
Merge branch 'main' of github.com:redis/redis-benchmarks-specification
filipecosta90 Apr 18, 2022
db9084a
Merge branch 'main' of github.com:redis/redis-benchmarks-specification
filipecosta90 Apr 21, 2022
2832612
Merge branch 'main' of github.com:redis/redis-benchmarks-specification
filipecosta90 Apr 23, 2022
ef2f1e2
Merge branch 'main' of github.com:redis/redis-benchmarks-specification
filipecosta90 Apr 25, 2022
fcfc1af
Merge branch 'main' of github.com:redis/redis-benchmarks-specification
filipecosta90 Apr 25, 2022
1401b3b
Added 11 extra STRING benchmarks
filipecosta90 Apr 25, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion pyproject.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
[tool.poetry]
name = "redis-benchmarks-specification"
version = "0.1.25"
version = "0.1.26"
description = "The Redis benchmarks specification describes the cross-language/tools requirements and expectations to foster performance and observability standards around redis related technologies. Members from both industry and academia, including organizations and individuals are encouraged to contribute."
authors = ["filipecosta90 <filipecosta.90@gmail.com>","Redis Performance Group <performance@redis.com>"]
readme = "Readme.md"
Expand Down
32 changes: 32 additions & 0 deletions ...ication/test-suites/memtier_benchmark-1Mkeys-load-string-with-100B-values-pipeline-10.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
version: 0.4
name: "memtier_benchmark-1Mkeys-load-string-with-100B-values-pipeline-10"
description: "Runs memtier_benchmark, for a keyspace length of 1M keys
loading STRINGs in which the value has a data size of 100 Bytes."
dbconfig:
configuration-parameters:
save: '""'
tested-commands:
- SET
redis-topologies:
- oss-standalone

build-variants:
- gcc:8.5.0-amd64-debian-buster-default

clientconfig:
run_image: redislabs/memtier_benchmark:edge
tool: memtier_benchmark
arguments: '"--pipeline" "10" "--data-size" "100" --command "SET __key__ __data__" --command-key-pattern="P" --key-minimum=1 --key-maximum 1000000 --test-time 180 -c 50 -t 4 --hide-histogram'
resources:
requests:
cpus: "4"
memory: "2g"
exporter:
redistimeseries:
break_by:
- version
- commit
timemetric: '$."ALL STATS".Runtime."Start time"'
metrics:
- '$."ALL STATS".*."Ops/sec"'
- '$."ALL STATS".*."Latency"'
32 changes: 32 additions & 0 deletions ...marks_specification/test-suites/memtier_benchmark-1Mkeys-load-string-with-100B-values.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
version: 0.4
name: "memtier_benchmark-1Mkeys-load-string-with-100B-values"
description: "Runs memtier_benchmark, for a keyspace length of 1M keys
loading STRINGs in which the value has a data size of 100 Bytes."
dbconfig:
configuration-parameters:
save: '""'
tested-commands:
- SET
redis-topologies:
- oss-standalone

build-variants:
- gcc:8.5.0-amd64-debian-buster-default

clientconfig:
run_image: redislabs/memtier_benchmark:edge
tool: memtier_benchmark
arguments: '"--data-size" "100" --command "SET __key__ __data__" --command-key-pattern="P" --key-minimum=1 --key-maximum 1000000 --test-time 180 -c 50 -t 4 --hide-histogram'
resources:
requests:
cpus: "4"
memory: "2g"
exporter:
redistimeseries:
break_by:
- version
- commit
timemetric: '$."ALL STATS".Runtime."Start time"'
metrics:
- '$."ALL STATS".*."Ops/sec"'
- '$."ALL STATS".*."Latency"'
32 changes: 32 additions & 0 deletions ...fication/test-suites/memtier_benchmark-1Mkeys-load-string-with-10B-values-pipeline-10.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
version: 0.4
name: "memtier_benchmark-1Mkeys-load-string-with-10B-values-pipeline-10"
description: "Runs memtier_benchmark, for a keyspace length of 1M keys
loading STRINGs in which the value has a data size of 10 Bytes."
dbconfig:
configuration-parameters:
save: '""'
tested-commands:
- SET
redis-topologies:
- oss-standalone

build-variants:
- gcc:8.5.0-amd64-debian-buster-default

clientconfig:
run_image: redislabs/memtier_benchmark:edge
tool: memtier_benchmark
arguments: '"--pipeline" "10" "--data-size" "10" --command "SET __key__ __data__" --command-key-pattern="P" --key-minimum=1 --key-maximum 1000000 --test-time 180 -c 50 -t 4 --hide-histogram'
resources:
requests:
cpus: "4"
memory: "2g"
exporter:
redistimeseries:
break_by:
- version
- commit
timemetric: '$."ALL STATS".Runtime."Start time"'
metrics:
- '$."ALL STATS".*."Ops/sec"'
- '$."ALL STATS".*."Latency"'
32 changes: 32 additions & 0 deletions ...hmarks_specification/test-suites/memtier_benchmark-1Mkeys-load-string-with-10B-values.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
version: 0.4
name: "memtier_benchmark-1Mkeys-load-string-with-10B-values"
description: "Runs memtier_benchmark, for a keyspace length of 1M keys
loading STRINGs in which the value has a data size of 10 Bytes."
dbconfig:
configuration-parameters:
save: '""'
tested-commands:
- SET
redis-topologies:
- oss-standalone

build-variants:
- gcc:8.5.0-amd64-debian-buster-default

clientconfig:
run_image: redislabs/memtier_benchmark:edge
tool: memtier_benchmark
arguments: '"--data-size" "10" --command "SET __key__ __data__" --command-key-pattern="P" --key-minimum=1 --key-maximum 1000000 --test-time 180 -c 50 -t 4 --hide-histogram'
resources:
requests:
cpus: "4"
memory: "2g"
exporter:
redistimeseries:
break_by:
- version
- commit
timemetric: '$."ALL STATS".Runtime."Start time"'
metrics:
- '$."ALL STATS".*."Ops/sec"'
- '$."ALL STATS".*."Latency"'
32 changes: 32 additions & 0 deletions ...marks_specification/test-suites/memtier_benchmark-1Mkeys-load-string-with-1KiB-values.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
version: 0.4
name: "memtier_benchmark-1Mkeys-load-string-with-1KiB-values"
description: "Runs memtier_benchmark, for a keyspace length of 1M keys
loading STRINGs in which the value has a data size of 1000 Bytes."
dbconfig:
configuration-parameters:
save: '""'
tested-commands:
- SET
redis-topologies:
- oss-standalone

build-variants:
- gcc:8.5.0-amd64-debian-buster-default

clientconfig:
run_image: redislabs/memtier_benchmark:edge
tool: memtier_benchmark
arguments: '"--data-size" "1000" --command "SET __key__ __data__" --command-key-pattern="P" --key-minimum=1 --key-maximum 1000000 --test-time 180 -c 50 -t 4 --hide-histogram'
resources:
requests:
cpus: "4"
memory: "2g"
exporter:
redistimeseries:
break_by:
- version
- commit
timemetric: '$."ALL STATS".Runtime."Start time"'
metrics:
- '$."ALL STATS".*."Ops/sec"'
- '$."ALL STATS".*."Latency"'
36 changes: 36 additions & 0 deletions ...hmarks_specification/test-suites/memtier_benchmark-1Mkeys-string-get-100B-pipeline-10.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
version: 0.4
name: "memtier_benchmark-1Mkeys-string-get-100B-pipeline-10"
description: "Runs memtier_benchmark, for a keyspace length of 1M keys
with a data size of 100 Bytes for each key."
dbconfig:
configuration-parameters:
save: '""'
preload_tool:
run_image: redislabs/memtier_benchmark:edge
tool: memtier_benchmark
arguments: '"--data-size" "100" "--command" "SET __key__ __value__" "--command-key-pattern" "P" "-c" "50" "-t" "2" "--hide-histogram"'
tested-commands:
- GET
redis-topologies:
- oss-standalone

build-variants:
- gcc:8.5.0-amd64-debian-buster-default

clientconfig:
run_image: redislabs/memtier_benchmark:edge
tool: memtier_benchmark
arguments: '"--pipeline" "10" "--data-size" "100" --command "GET __key__" --command-key-pattern="R" -c 50 -t 2 --hide-histogram --test-time 180'
resources:
requests:
cpus: "2"
memory: "2g"
exporter:
redistimeseries:
break_by:
- version
- commit
timemetric: '$."ALL STATS".Runtime."Start time"'
metrics:
- '$."ALL STATS".*."Ops/sec"'
- '$."ALL STATS".*."Latency"'
36 changes: 36 additions & 0 deletions redis_benchmarks_specification/test-suites/memtier_benchmark-1Mkeys-string-get-100B.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
version: 0.4
name: "memtier_benchmark-1Mkeys-string-get-100B"
description: "Runs memtier_benchmark, for a keyspace length of 1M keys
with a data size of 100 Bytes for each key."
dbconfig:
configuration-parameters:
save: '""'
preload_tool:
run_image: redislabs/memtier_benchmark:edge
tool: memtier_benchmark
arguments: '"--data-size" "100" "--command" "SET __key__ __value__" "--command-key-pattern" "P" "-c" "50" "-t" "2" "--hide-histogram"'
tested-commands:
- GET
redis-topologies:
- oss-standalone

build-variants:
- gcc:8.5.0-amd64-debian-buster-default

clientconfig:
run_image: redislabs/memtier_benchmark:edge
tool: memtier_benchmark
arguments: '"--data-size" "100" --command "GET __key__" --command-key-pattern="R" -c 50 -t 2 --hide-histogram --test-time 180'
resources:
requests:
cpus: "2"
memory: "2g"
exporter:
redistimeseries:
break_by:
- version
- commit
timemetric: '$."ALL STATS".Runtime."Start time"'
metrics:
- '$."ALL STATS".*."Ops/sec"'
- '$."ALL STATS".*."Latency"'
36 changes: 36 additions & 0 deletions ...chmarks_specification/test-suites/memtier_benchmark-1Mkeys-string-get-10B-pipeline-10.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
version: 0.4
name: "memtier_benchmark-1Mkeys-string-get-10B-pipeline-10"
description: "Runs memtier_benchmark, for a keyspace length of 1M keys
with a data size of 10 Bytes for each key."
dbconfig:
configuration-parameters:
save: '""'
preload_tool:
run_image: redislabs/memtier_benchmark:edge
tool: memtier_benchmark
arguments: '"--data-size" "10" "--command" "SET __key__ __value__" "--command-key-pattern" "P" "-c" "50" "-t" "2" "--hide-histogram"'
tested-commands:
- GET
redis-topologies:
- oss-standalone

build-variants:
- gcc:8.5.0-amd64-debian-buster-default

clientconfig:
run_image: redislabs/memtier_benchmark:edge
tool: memtier_benchmark
arguments: '"--pipeline" "10" "--data-size" "10" --command "GET __key__" --command-key-pattern="R" -c 50 -t 2 --hide-histogram --test-time 180'
resources:
requests:
cpus: "2"
memory: "2g"
exporter:
redistimeseries:
break_by:
- version
- commit
timemetric: '$."ALL STATS".Runtime."Start time"'
metrics:
- '$."ALL STATS".*."Ops/sec"'
- '$."ALL STATS".*."Latency"'
36 changes: 36 additions & 0 deletions redis_benchmarks_specification/test-suites/memtier_benchmark-1Mkeys-string-get-10B.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
version: 0.4
name: "memtier_benchmark-1Mkeys-string-get-10B"
description: "Runs memtier_benchmark, for a keyspace length of 1M keys
with a data size of 10 Bytes for each key."
dbconfig:
configuration-parameters:
save: '""'
preload_tool:
run_image: redislabs/memtier_benchmark:edge
tool: memtier_benchmark
arguments: '"--data-size" "10" "--command" "SET __key__ __value__" "--command-key-pattern" "P" "-c" "50" "-t" "2" "--hide-histogram"'
tested-commands:
- GET
redis-topologies:
- oss-standalone

build-variants:
- gcc:8.5.0-amd64-debian-buster-default

clientconfig:
run_image: redislabs/memtier_benchmark:edge
tool: memtier_benchmark
arguments: '"--data-size" "10" --command "GET __key__" --command-key-pattern="R" -c 50 -t 2 --hide-histogram --test-time 180'
resources:
requests:
cpus: "2"
memory: "2g"
exporter:
redistimeseries:
break_by:
- version
- commit
timemetric: '$."ALL STATS".Runtime."Start time"'
metrics:
- '$."ALL STATS".*."Ops/sec"'
- '$."ALL STATS".*."Latency"'
36 changes: 36 additions & 0 deletions ...hmarks_specification/test-suites/memtier_benchmark-1Mkeys-string-get-1KiB-pipeline-10.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
version: 0.4
name: "memtier_benchmark-1Mkeys-string-get-1KiB-pipeline-10"
description: "Runs memtier_benchmark, for a keyspace length of 1M keys
with a data size of 1000 Bytes for each key."
dbconfig:
configuration-parameters:
save: '""'
preload_tool:
run_image: redislabs/memtier_benchmark:edge
tool: memtier_benchmark
arguments: '"--data-size" "1000" "--command" "SET __key__ __value__" "--command-key-pattern" "P" "-c" "50" "-t" "2" "--hide-histogram"'
tested-commands:
- GET
redis-topologies:
- oss-standalone

build-variants:
- gcc:8.5.0-amd64-debian-buster-default

clientconfig:
run_image: redislabs/memtier_benchmark:edge
tool: memtier_benchmark
arguments: '"--pipeline" "10" "--data-size" "1000" --command "GET __key__" --command-key-pattern="R" -c 50 -t 2 --hide-histogram --test-time 180'
resources:
requests:
cpus: "2"
memory: "2g"
exporter:
redistimeseries:
break_by:
- version
- commit
timemetric: '$."ALL STATS".Runtime."Start time"'
metrics:
- '$."ALL STATS".*."Ops/sec"'
- '$."ALL STATS".*."Latency"'
36 changes: 36 additions & 0 deletions redis_benchmarks_specification/test-suites/memtier_benchmark-1Mkeys-string-get-1KiB.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
version: 0.4
name: "memtier_benchmark-1Mkeys-string-get-1KiB"
description: "Runs memtier_benchmark, for a keyspace length of 1M keys
with a data size of 1000 Bytes for each key."
dbconfig:
configuration-parameters:
save: '""'
preload_tool:
run_image: redislabs/memtier_benchmark:edge
tool: memtier_benchmark
arguments: '"--data-size" "1000" "--command" "SET __key__ __value__" "--command-key-pattern" "P" "-c" "50" "-t" "2" "--hide-histogram"'
tested-commands:
- GET
redis-topologies:
- oss-standalone

build-variants:
- gcc:8.5.0-amd64-debian-buster-default

clientconfig:
run_image: redislabs/memtier_benchmark:edge
tool: memtier_benchmark
arguments: '"--data-size" "1000" --command "GET __key__" --command-key-pattern="R" -c 50 -t 2 --hide-histogram --test-time 180'
resources:
requests:
cpus: "2"
memory: "2g"
exporter:
redistimeseries:
break_by:
- version
- commit
timemetric: '$."ALL STATS".Runtime."Start time"'
metrics:
- '$."ALL STATS".*."Ops/sec"'
- '$."ALL STATS".*."Latency"'