Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
Benchmarking library for clojure
Clojure HTML Shell

Fetching latest commit…

Cannot retrieve the latest commit at this time

Failed to load latest commit information.
src/criterium
test-resources/codox
test/criterium
.gitignore
README.md
ReleaseNotes.md
project.clj

README.md

Criterium

Criterium measures the computation time of an expression. It is designed to address some of the pitfalls of benchmarking, and benchmarking on the JVM in particular.

This includes:

  • statistical processing of multiple evaluations
  • inclusion of a warm-up period, designed to allow the JIT compiler to optimise its code
  • purging of gc before testing, to isolate timings from GC state prior to testing
  • a final forced GC after testing to estimate impact of cleanup on the timing results

Usage

The top level interface is in criterium.core.

(use 'criterium.core)

Use bench to run a benchmark in a simple manner.

(bench (Thread/sleep 1000) :verbose)

By default bench is quiet about its progress. Run with-progress-reporting to get progress information on out.

(with-progress-reporting (bench (Thread/sleep 1000) :verbose))
(with-progress-reporting (quick-bench (Thread/sleep 1000) :verbose))

Lower level functions are available, that separate benchmark statistic generation and reporting.

(report-result (benchmark (Thread/sleep 1000)) :verbose)
(report-result (quick-benchmark (Thread/sleep 1000)))

Note that results are returned to the user to prevent JIT from recognising that the results are not used. For functions that are very fast, or return a lot of data, you may need to supply a function to reduce the results to prevent excessive memory allocation.

(bench (rand) :reduce-with +)

References

API Documentation

See Elliptic Group for a Java benchmarking library. The accompanying article describes many of the JVM benchmarking pitfalls.

See Criterion for a Haskell benchmarking library that applies many of the same statistical techniques.

Installation

The library can be installed through Leiningen or through maven.

Todo

Serial correlation detection. Multimodal distribution detection. Use kernel density estimators?

License

Licensed under EPL

Something went wrong with that request. Please try again.