Benchmark aggregator performances

[jpraynaud]

Why

We need to benchmark the performances of the aggregator with the stress test tool and use them to identify bottlenecks.

What

Create a benchmark tool using the stress test tool to produce statistics of performances given different number of signers and clients.

How

• Run a series of stress tests on the aggregator over a bi-dimensional range of parameters [Nmin,Nmax]x[Mmin,Mmax] where:
  • Nmax (Nmin) is the maximum (minimum) number of signers that an aggregator can sustain without clients
  • Mmax (Mmin) is the maximum (minimum) number of clients that an aggregator can sustain without signers
• Gather statistics over this range and prepare a spreadsheet with:
  • Visual representations (e.g. bubble chart)
  • Phase duration statistics
• Add README to explain how to use the benchmark tool

Next

• Identify bottlenecks zones (failure or high duration for phases)
• Analyze bottlenecks and file issues

[jpraynaud]

This is the spreadsheet used for reporting and analysis of aggregator benchmark runs: https://docs.google.com/spreadsheets/d/10ojWfDjj25GVzz3lAH9ih5ANuhbkCXf_n5k49LhoZLg

And this is an example of the visual representation of the benchmark: