BENCHMARKS.md

Benchmarks (as of September 2019)

These benchmarks compare the single-threaded decoding performance of both Symphonia and FFmpeg with various audio files.

The benchmarks were executed on an Arch Linux system with a Core i7 4790k and 32GB of RAM, for a minimum of 20 runs each. Hyperfine was used to execute the test. The full benchmark script is as follows:

#!/bin/bash
IN="${1@Q}"
hyperfine -m 20 "ffmpeg -threads 1 -benchmark -v 0 -i ${IN} -f null -" "symphonia-play --decode-only ${IN}"

MP3, 192kbps @ 44.1kHz

Command	Mean [ms]	Min [ms]	Max [ms]	Relative
Symphonia	306.2 ± 3.0	301.8	312.5	1.1
FFmpeg	272.7 ± 4.3	267.6	285.3	1.0

MP3, 320kbps @ 44.1kHz

Command	Mean [ms]	Min [ms]	Max [ms]	Relative
Symphonia	355.1 ± 8.4	348.2	376.2	1.1
FFmpeg	316.0 ± 3.5	308.8	322.8	1.0

FLAC, 24-bit @ 96kHz

Decoder	Mean [ms]	Min [ms]	Max [ms]	Relative
Symphonia	453.6 ± 2.9	449.3	462.4	1.0
FFmpeg	501.9 ± 4.3	496.4	512.7	1.1

FLAC, 24-bit @ 48kHz

Command	Mean [ms]	Min [ms]	Max [ms]	Relative
Symphonia	324.0 ± 8.9	315.4	346.3	1.0
FFmpeg	331.0 ± 7.4	323.6	354.5	1.0

WAVE, S32LE @ 44.1kHz

Command	Mean [ms]	Min [ms]	Max [ms]	Relative
Symphonia	84.5 ± 1.8	81.8	89.1	1.0
FFmpeg	129.8 ± 3.4	123.4	136.1	1.5