Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Report only runs one iteration #87

Open
sandeep-biddala opened this issue Oct 2, 2020 · 3 comments
Open

Report only runs one iteration #87

sandeep-biddala opened this issue Oct 2, 2020 · 3 comments

Comments

@sandeep-biddala
Copy link

What is the use of the --report option? It can only run one iteration. Wouldn't it be useful if the report contains the details of all the iterations, so that the client can perform other analysis with this data?

Also, if both --stats and --report options are used, then there is a panic thrown as he reports vector is empty when the report option is used.

@fcsonline
Copy link
Owner

The goal of --report option is to record just a single test plan. This execution is used later to be compared with --threshold option. This can help you to do performance tests in your CI to ensure, for example, that your API endpoint performs as always with ensuring that the difference is below the given threshold value.

On the other hand, I'm going to review this case you are mentioning about running --stats and --report together.

@Hellseher
Copy link

Hi,

I've faced the same. May you add some more documentation string to --help or add some example on how to use that options please?

--report --compare and --threshold

@fcsonline
Copy link
Owner

Sure, it is a pending task I have.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants