Benchmarks for parrot VM
Other Parrot Gnuplot Shell
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
.gitignore
README.md
addit2.pir
all-bench.sh
array_access.pir
arriter.pir
bench.ploticus
bench.sh
bench_newp.pasm
dispatch.pir
do-bench.sh
fib.pir
freeze.pasm
hamming.pir
log.bench-20140321
log.bench-20140530
log.bench-20140604
log.bench-20140631
log.bench-20140701
log.bench-20141119
log.bench-3.0.slowdown
log.bench-3.0.slowdown.numbers
log.bench-chirag-2.7-2.8
mops.pasm
mops_intval.pasm
oo5.pir
oo6.pir
oofib.pir
parrot-bench-2.7-2.8.data
parrot-bench-2.7-2.8.plot
parrot-bench-2.7-2.8.png
parrot-bench-20140321-1.data
parrot-bench-20140321-gnuplot.png
parrot-bench-20140321.data
parrot-bench-20140321.plot
parrot-bench-20140321.png
parrot-bench-20140530-1.data
parrot-bench-20140530.data
parrot-bench-20140701.data
parrot-bench-20140701.plot
parrot-bench-20140701.png
parrot-bench-20141119.data
parrot-bench-20141119.plot
parrot-bench-20141119.png
parrot-bench-20141207.data
parrot-bench-20141207.plot
parrot-bench-20141207.png
parrot-bench-20150121.data
parrot-bench-20150121.plot
parrot-bench-20150121.png
parrot-bench-m32-20140631.data
parrot-bench-m32-20140631.plot
parrot-bench-m32-20140631.png
parrot-bench-template.plot
primes2_i.pir
run-bench.sh
run-bench_old.sh
stress1.pasm
stress3.pasm
vpm.pir

README.md

parrot-bench

Curve

RELEASE tags seconds 4x variance rel %
RELEASE_1_8_0 9.883043488 (+-0.25%)
RELEASE_1_9_0 8.889300201 (+-0.09%) +11.18%
RELEASE_2_0_0 8.172728006 (+-0.22%) +8.77%
RELEASE_2_1_0 8.352471553 (+-0.37%) +1.79%
RELEASE_2_1_1 8.382326286 (+-0.43%) -0.36%
RELEASE_2_2_0 7.768856426 (+-0.55%) +7.90%
RELEASE_2_3_0 8.814267878 (+-0.47%) -11.86%
RELEASE_2_4_0 8.383203835 (+-0.47%) +5.14%
RELEASE_2_5_0 8.368028381 (+-0.63%) +0.18%
RELEASE_2_6_0 8.292280282 (+-0.40%) +0.91%
RELEASE_2_7_0 7.614940353 (+-0.53%) +8.89%
RELEASE_2_8_0 7.492562325 (+-0.42%) +1.63%
RELEASE_2_9_0 9.437535389 (+-0.29%) -20.61%
RELEASE_2_9_1 8.744459705 (+-0.30%) +7.93%
RELEASE_2_10_0 8.165184213 (+-0.50%) +0.09%
RELEASE_2_10_1 8.154784983 (+-0.60%) +0.13%
RELEASE_2_11_0 8.502190304 (+-0.70%) -4.09%
RELEASE_3_0_0 10.086863290 (+-0.55%) -13.31%
RELEASE_3_1_0 10.527375496 (+-0.06%) -4.47%
RELEASE_3_2_0 10.879345062 (+-0.19%) -3.24%
RELEASE_3_3_0 10.776853741 (+-1.42%) +0.95%
RELEASE_3_4_0 11.436597522 (+-0.49%) -5.77%
RELEASE_3_5_0 11.405430639 (+-1.46%) +0.27%
RELEASE_3_6_0 10.364548200 (+-1.64%) +10.04%
RELEASE_3_7_0 10.164760021 (+-0.31%) +1.97%
RELEASE_3_8_0 9.416783644 (+-0.32%) +7.94%
RELEASE_3_9_0 9.544491018 (+-0.31%) -1.34%
RELEASE_3_10_0 10.144179660 (+-0.37%) -0.57%
RELEASE_3_11_0 10.056918352 (+-0.35%) +0.87%
RELEASE_4_0_0 9.614998544 (+-0.36%) -0.73%
RELEASE_4_1_0 9.506818520 (+-0.16%) +3.18%
RELEASE_4_2_0 9.871481188 (+-1.60%) -3.69%
RELEASE_4_3_0 9.967648008 (+-0.29%) -0.96%
RELEASE_4_4_0 10.216574730 (+-1.76%) -2.44%
RELEASE_4_5_0 9.899043131 (+-1.17%) +3.21%
RELEASE_4_6_0 9.480718387 (+-0.44%) +4.41%
RELEASE_4_7_0 9.430881797 (+-0.20%) +0.53%
RELEASE_4_8_0 9.532461810 (+-0.56%) -1.07%
RELEASE_4_9_0 9.503186442 (+-0.13%) +0.31%
RELEASE_4_10_0 9.582978344 (+-0.25%) +0.33%
RELEASE_4_11_0 9.809432968 (+-0.75%) -2.31%
RELEASE_5_0_0 9.809035809 (+-0.25%) -3.12%
RELEASE_5_1_0 9.797141010 (+-0.46%) +0.37%
RELEASE_5_2_0 9.776151688 (+-0.31%) +0.21%
RELEASE_5_3_0 10.248564329 (+-0.33%) -4.61%
RELEASE_5_4_0 10.249601501 (+-0.37%) -0.01%
RELEASE_5_5_0 10.173360877 (+-0.47%) +0.75%
RELEASE_5_6_0 10.127534872 (+-0.56%) +0.45%
RELEASE_5_7_0 10.243308239 (+-0.46%) -1.14%
RELEASE_5_9_0 10.019290711 (+-0.52%) +2.19%
RELEASE_5_10_0 10.174221599 (+-1.61%) -1.55%
RELEASE_6_0_0 10.118887562 (+-1.47%) +0.54%
RELEASE_6_1_0 10.507498333 (+-1.63%) -3.84%
RELEASE_6_2_0 10.049274421 (+-0.18%) +4.36%
RELEASE_6_3_0 10.092252782 (+-0.37%) -0.43%
RELEASE_6_4_0 10.034127913 (+-0.58%) +0.58%
RELEASE_6_5_0 9.908168937 (+-0.38%) +1.26%
RELEASE_6_6_0 10.074251936 (+-0.39%) -1.68%
RELEASE_6_7_0 9.995709839 (+-0.21%) +0.78%
RELEASE_6_8_0 9.996542905 (+-0.38%) -0.01%
RELEASE_6_9_0 10.058208507 (+-0.38%) -0.62%
RELEASE_6_10_0 10.020213315 (+-0.71%) +0.38%
RELEASE_6_11_0 8.698516675 (+-0.39%) +13.19%
RELEASE_7_0_0 9.578145292 (+-0.41%) -10.11%
master 9.404290668 (+-0.20%) +1.82%
stringbuilder 8.404095982 (+-0.54%) +10.64%

Time in seconds to run all these .pir and .pasm tests without -O.

The tests were selected from examples/benchmarks. All tests which run without error on all successfully built parrots.

Comments:

  • RELEASE_1_9_0: +11.18% Merged Freeze/Thaw and Bytecode generator/loader
  • RELEASE_2_3_0: -11.86% new pcc calling convention
  • RELEASE_2_9_0: -20.61% gc_massacre. Default GC set MS2 5a4a0d5c03922
  • RELEASE_3_0_0: -13.31% Use Packfile PMC API to run bytecode (embed API)
  • RELEASE_3_6_0: +10.04% Class.add_vtable_override. Integers, floats and strings stored in lexicals.
  • RELEASE_4_6_0: +4.41% Added init_pmc method to PackFileView
  • RELEASE_5_3_0: -4.61% ??
  • RELEASE_6_5_0: +4.41% Optimize GC write barriers in the pmc's #1069
  • RELEASE_6_11_0: +13.19% ResizablePMCArray with offset #1152