FPBench provides benchmarks, compilers, and standards for the floating-point research community.

Setup

The FPBench tools require Racket. Use the official installer to install Racket, or use distro-provided packages provided they are version 8.0 or later of Racket (earlier versions are not supported).

Test that Racket is installed correctly and has a correct version:

$ racket
Welcome to Racket v8.13.
> (exit)

Then, run make setup to install dependencies and compile the tools.

Benchmarks

The FPBench benchmarks are located in benchmarks/ in FPCore format. These benchmarks are drawn from a variety of sources; you are welcome to contribute more by filing an issue.

Compilers

FPBench develops two compiler tools for FPCore programs:

• export.rkt, which exports FPCore computations to languages like C or JavaScript and to input formats for tools like Daisy, Gappa, and FPTaylor.
• transform.rkt, which applies transformations FPCore computations, such as sipmlifying preconditions, unrolling loops, or expanding syntax sugar.

These syntax and options for these tools are documented in tools.md.

Standards

The FPBench standards are located online. FPBench contains standards for:

• The FPCore format for floating-point computations. FPCore is a simple S-expression functional programming language and can represent arithmetic, transcendental operators, loops, and conditionals.
• Metadata to describe the provenance and interpretation of FPCore computations.
• Measures to describe accuracy measurements for FPCore computations. Several measures are standardized.

Each standard has achieved 1.1 status and can be used by implementations. The standards are maintained in another repository on Github.

Papers

Toward a Standard Benchmark Format and Suite for Floating-Point Analysis, at NSV’16, by N. Damouche, M. Martel, P. Panchekha, C. Qiu, A. Sanchez-Stern, and Z. Tatlock

Described the FPBench standards project, including the FPCore standard. The standards (in www/spec) continue this work.

Combining Tools for Optimization and Analysis of Floating-Point Computations, at FM’18, by H. Becker, P. Panchekha, E. Darulova, and Z. Tatlock

Described experiments combining Daisy and Herbie using the FPBench format and tools. All scripts are available in the daisy_herbie branch.

Helping Out

FPBench is organized on our mailing list where we discuss work in progress, edit proposed standards, and announce major improvements. Email us if you have questions or would like to get involved!