Rust port of `criterion` for benchmarking

[steveklabnik]

Issue by graydon
Wednesday May 29, 2013 at 21:22 GMT

For earlier discussion, see rust-lang/rust#6812

This issue was labelled with: A-an-interesting-project, A-benchmarks, A-instrumentation, A-libs, I-enhancement in the Rust repository

---

The built in unit tester presently contains some very crude one-off automated benchmarking stuff. It was initially a clone of the Go testing.B benchmark system (http://golang.org/pkg/testing/#B) but started to drift towards doing statistical measurement in order to get a more stable signal.

I believe Bryan O'Sullivan's criterion library (https://github.com/bos/criterion) is the state of the art here. We should port / emulate whatever it does well.

[lucy]

Core_bench is also something to look at. It is broadly similar to criterion but has a possibly better way of estimating costs.
https://blogs.janestreet.com/?p=608
https://github.com/janestreet/core_bench

[briansmith]

Is this something that would affect the API, or is this purely an implementation detail? In particular, is this something that can be deferred past the stabilization of the benchmarking interface for stable Rust?

[kmcallister]

criterion.rs is a thing that exists now.

[Centril]

Since criterion.rs exists now, I'm closing this.