This project is an effort to reproducibly benchmark "in the wild" Rust code against newer compiler versions to detect performance regressions. The data is currently published to https://lolbench.rs.
Want to contribute and are looking for the list of benchmarks we'd like help adding?
- clang (Linux only)
Building & Running
$ git submodule update --init $ cargo test-core
Useful cargo subcommand aliases
cargo build-websiteruns the website generator using the provided data directory. Pass the
--helpflag to see what's required.
cargo fmt-coreformats only those crates which should be rustfmt'd -- notably our fork of criterion isn't rustfmt-friendly right now. Useful for
cargo watch -x fmt-core.
cargo test-coreruns the tests for every non-benchmark crate except for criterion. At writing, that's
cargo new-bench-crateruns a lolbench command to create a new benchmark crate in the benches directory.
cargo build-all [--release]builds a binary for every benchmark function. caution: this will generate dozens of gigabytes of data in your target directory.
cargo test-all [--release]runs the test for every benchmark function, which consists of warming it up and running through a couple of iterations. caution: this will generate dozens of gigabytes of data in your target directory.
lolbench is distributed under the terms of both the MIT license and the Apache License (Version 2.0). Some included benchmarks have their own separate licenses, see those directories and their Cargo.toml metadata for details.