Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Provide preparation command to be run between benchmarking different commands #91

Closed
RalfJung opened this issue Oct 8, 2018 · 3 comments
Labels

Comments

@RalfJung
Copy link

RalfJung commented Oct 8, 2018

I want to benchmark two versions of rustc against each other, measuring the build time of a project that however has some build dependencies, downloading and building which I do not want included in the benchmark. However, after using one version of rustc, I need to rm -rf target to enable the other one to build; these are both self-compiled git versions of Rust and their detection of when to recompile because the compiler changed does not work reliably.

Unfortunately, this is not possible with one hyperfine invocation currently; instead I have to resort to calling hyperfine twice and clean the build dir in between. It would be great if hyperfine had a preparation command that was run in-between different commands being benchmarked, but NOT in-between different runs of the same benchmark.

@sharkdp
Copy link
Owner

sharkdp commented Oct 9, 2018

Thank you for the feedback!

Sounds like a good idea to me.

@sharkdp
Copy link
Owner

sharkdp commented Jan 14, 2019

Fixed via #129 by @colinwahl

@sharkdp
Copy link
Owner

sharkdp commented Jun 8, 2019

Released in v1.6.0.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants