Skip to content

Commit

Permalink
simplebench/bench-backup: add --count and --no-initial-run
Browse files Browse the repository at this point in the history
Add arguments to set number of test runs per table cell and to disable
initial run that is not counted in results.

It's convenient to set --count 1 --no-initial-run to fast run test
onece, and to set --count to some large enough number for good
precision of the results.

Signed-off-by: Vladimir Sementsov-Ogievskiy <vsementsov@virtuozzo.com>
  • Loading branch information
Vladimir Sementsov-Ogievskiy committed May 4, 2021
1 parent 0dc9f81 commit 8fa4ee1
Showing 1 changed file with 11 additions and 1 deletion.
12 changes: 11 additions & 1 deletion scripts/simplebench/bench-backup.py
Expand Up @@ -155,7 +155,8 @@ def bench(args):
'qemu-binary': path
})

result = simplebench.bench(bench_func, test_envs, test_cases, count=3)
result = simplebench.bench(bench_func, test_envs, test_cases,
count=args.count, initial_run=args.initial_run)
with open('results.json', 'w') as f:
json.dump(result, f, indent=4)
print(results_to_text(result))
Expand Down Expand Up @@ -211,4 +212,13 @@ def __call__(self, parser, namespace, values, option_string=None):
both: generate two test cases for each src:dst pair''',
default='direct', choices=('direct', 'cached', 'both'))

p.add_argument('--count', type=int, default=3, help='''\
Number of test runs per table cell''')

# BooleanOptionalAction helps to support --no-initial-run option
p.add_argument('--initial-run', action=argparse.BooleanOptionalAction,
help='''\
Do additional initial run per cell which doesn't count in result,
default true''')

bench(p.parse_args())

0 comments on commit 8fa4ee1

Please sign in to comment.